373 Commits

Author SHA1 Message Date
Oliver Gorwits
adeeaaf9bd also active nodes and IPs 2017-06-28 14:16:53 +01:00
Oliver Gorwits
47bf38568e #15 record device and node statistics once a day 2017-06-28 12:03:52 +01:00
Oliver Gorwits
5efdd7501a fix bug on device port view (speed-up) to avoid DB query on every node 2017-06-26 19:40:13 +01:00
Oliver Gorwits
b93b6dbb83 remove phone_ouis and wap_ouis code 2017-06-24 18:31:51 +01:00
Oliver Gorwits
55edd65734 #311 added duplicate devices report with option to delete 2017-06-24 18:11:18 +01:00
Oliver Gorwits
ec8e0ca051 add "retry" button to reset device skip timeout count 2017-06-19 18:47:44 +01:00
Oliver Gorwits
4f613ea553 devices_no and devices_only settings allow global worker restriction 2017-06-18 23:32:21 +01:00
Oliver Gorwits
f418b1c081 add last_defer stamp to timedoutdevices report 2017-06-13 07:21:31 +01:00
Oliver Gorwits
ef0d326287 retry jobs once per week 2017-06-12 22:31:20 +01:00
Oliver Gorwits
275e01ff59 include last_defer timestamp when deferring a job 2017-06-06 07:56:50 +01:00
Oliver Gorwits
3aa34f12dc add DNS to SNMP Connect Failures report 2017-05-30 21:01:35 +01:00
Oliver Gorwits
5f58cfbbe5 change device_identity to be list of mappings 2017-05-28 09:14:08 +01:00
Oliver Gorwits
9a72d7e74a Avoid lock/defer of jobs deined via ACL
This commit adds a table 'device_skip' that is used to restrict job queue
searches to avoid jobs that are not permitted on this backend via *_no ACLs,
or jobs on devices that have previously encountered multiple SNMP timeouts.

When the backend loads or a device is added, a row is added to the table if
that device should not be polled on this backend (together with the job
actions which are to be skipped/denied). When a device SNMP connect fails a
counter in the same row (or a new row) is incremented.

There is also a new report 'SNMP Connect Failures' to show the devices with
non-zero SNMP connect failure counters. A configurable limit in the setting
'max_deferrals' is used to set the threshold of no longer polling the device.

To reset the deferrals/failures count, restart the Netdisco backend (which
regenerates 'device_skip' cache entries).

Squashed commit of the following:

commit b5e32c219d
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 20:55:14 2017 +0100

    show all failed connections in report

commit ffce3cee84
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 20:12:39 2017 +0100

    only resolve fqdn once

commit cc4f680f01
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 20:10:20 2017 +0100

    Revert "only resolve fqdn once"

    This reverts commit 3d136a54de.

commit d8d082b30e
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 20:09:05 2017 +0100

    a report to show SNMP failures

commit 3d136a54de
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 19:37:58 2017 +0100

    only resolve fqdn once

commit 4550b8a84c
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 17:27:43 2017 +0100

    skipover now implicit from deferrals/actionset; fix sql where logic with better correlation

commit b51edbccd2
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 16:11:29 2017 +0100

    only abort lock if action matches badactions

commit 415559b24f
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 13:56:42 2017 +0100

    set skipover true when adding to actionset

commit 1086f2c467
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 13:50:56 2017 +0100

    fix empty actionset

commit 31962580b8
Merge: 9b2e993e 6808133b
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 13:25:08 2017 +0100

    Merge branch 'og-device_skip' of github.com:netdisco/netdisco into og-device_skip

commit 6808133bdb
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 13:19:54 2017 +0100

    in-job checks for acls are required for netdisco-do foreground actions

commit 3944dd7813
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 13:18:30 2017 +0100

    avoid extra device lookup

commit 9b2e993e0f
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 12:31:36 2017 +0100

    also delete device_skip rows when deleting device

commit b55854e91d
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 11:34:27 2017 +0100

    actions in device_skip table are now an array/set

commit 5e126eef07
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 09:36:33 2017 +0100

    typo

commit 44266f2767
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 09:14:25 2017 +0100

    *able checks within jobs should not be necessary with skiplist

commit e7c22e7d11
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 08:58:57 2017 +0100

    increment deferrals field when job is deferred

commit 88ae9c00ba
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 08:40:27 2017 +0100

    turn connect fail into defer

commit eac1857043
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue May 23 08:26:59 2017 +0100

    rename failures column to be deferrals

commit 96ed444bbb
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon May 22 22:52:51 2017 +0100

    set up list of jobs the backend instance should skip

commit 3a0019296d
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon May 22 22:01:50 2017 +0100

    separate out is_*able last_* checks

commit cf8589aba2
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun May 21 22:35:38 2017 +0100

    change from ignore to skip name

commit ed193356f8
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun May 21 14:52:33 2017 +0100

    device_ignore table to track devices to skip in polling
2017-05-27 08:50:08 +01:00
Oliver Gorwits
da04522199 add site_local_files feature for easy lib/template override 2017-05-14 21:12:19 +01:00
Oliver Gorwits
3816aad829 support for device identity steering via device_identity 2017-05-12 20:19:04 +01:00
Oliver Gorwits
95598b5468 basic implementation of named acls (need to tidy up calls to check_acl) 2017-05-07 13:34:21 +01:00
Oliver Gorwits
2c41b2925d template_paths config to allow easier override of web templates 2017-05-06 17:59:50 +01:00
Oliver Gorwits
3af2bc2fec typo 2017-05-06 16:52:51 +01:00
Oliver Gorwits
d0472a9ddf #309 missing Device Port VLAN Mismatch CSV template 2017-05-06 16:50:34 +01:00
Oliver Gorwits
d74ccac4f6 rename *-daemon apps to be *-backend
Squashed commit of the following:

commit 39b438aa4b
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat May 6 16:40:11 2017 +0100

    add release notes

commit ca4ea90d35
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat May 6 16:32:06 2017 +0100

    update distmeta

commit 4e35b904b0
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat May 6 16:30:22 2017 +0100

    rename files from Daemon to Backend

commit 86a605ba68
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat May 6 16:26:43 2017 +0100

    rename daemon to backend in code

commit ffe8fc180f
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat May 6 16:15:57 2017 +0100

    add daemon files which exec to backend equivalents

commit 53e041594e
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat May 6 15:32:49 2017 +0100

    rename netdisco-daemon to netdisco-backend
2017-05-06 16:40:48 +01:00
Oliver Gorwits
3ec84161ae New report for Port VLAN Mismatches (M. Bernstein) 2017-04-25 12:26:09 +01:00
Oliver Gorwits
48cb6dd4c1 Fix DB schema files location with Module::Build 2017-04-24 12:41:15 +01:00
Oliver Gorwits
d23b32500f relocate repo files so ND2 is the only code 2017-04-14 23:08:55 +01:00