Commit Graph

75 Commits

Author SHA1 Message Date
Oliver Gorwits
5839fd4404 enable apache style access logging per https://github.com/netdisco/netdisco/issues/715#issuecomment-624201815 2020-09-26 11:37:45 +01:00
Oliver Gorwits
87db37180b #733 strip nonprinting characters from OUI table 2020-07-08 22:23:34 +01:00
Christian Ramseyer
356a4a77f9 Add netdisco-do Perldoc for getapikey 2020-04-21 00:57:21 +02:00
Oliver Gorwits
2827d24f02 change from MCE::Shared to MCE::Queue after resolution of crash bug 2020-02-09 10:00:36 +00:00
Oliver Gorwits
d35a29931a change from MCE::Queue to MCE::Shared to better handle signals 2020-02-04 21:34:00 +00:00
Oliver Gorwits
92875f0e6f fix #671 need to discover nodes on CLI discover 2019-12-21 22:19:09 +00:00
Christian Ramseyer
b82e1d273b remove unnecessary blank line added in last commit 2019-10-04 23:50:18 +02:00
Christian Ramseyer
372ada2726 netdisco-do overrides _min_age config
Give the user wanting to manually run a discover|arpnip|macsuck job in
the foreground preference over the respective `_min_age` setting. Tiny
quality of life improvement that mostly comes up in debugging.
2019-10-04 23:40:23 +02:00
Oliver Gorwits
542837d266 #591 domain_suffix can be list and supports (simple) regexp
Squashed commit of the following:

commit 975e4c6afc
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue Sep 3 13:35:26 2019 +0100

    also support regexp in domain_suffix

commit 0a2b5c8fa2
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue Sep 3 13:17:17 2019 +0100

    fix rancid, graph, and nodemonitor

commit 6d881de3ff
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue Sep 3 13:11:54 2019 +0100

    improve docs and set default domain_suffix to be list

commit 1dcafc08a8
Merge: 9a752e02 14ac69dc
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue Sep 3 13:00:39 2019 +0100

    Merge branch 'master' into og-multiple-domain-suffix

commit 9a752e0298
Merge: c836619f 82a99ea9
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Tue Sep 3 09:45:25 2019 +0100

    Merge branch 'master' into og-multiple-domain-suffix

commit c836619f8c
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Thu Jun 13 07:52:45 2019 +0100

    hokey fix for nodes with domains

commit fed14bd810
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Thu Jun 13 07:02:09 2019 +0100

    basic implementation, rancid graph and nodemonitor missing
2019-09-03 13:35:43 +01:00
nick n
a734890055 some documentation fixes (#640)
* a few more files to ignore

* the pgtune we reference seems to be dead, provide
a few alternatives.

* steal pod syntax check from snmp::info, but don't bother with checking Test::Pod version.
we want 1.22 or later, which was released in 2005

* reference the release notes in our wiki. changes you need to make manually during upgrades are documented there.

* add pod test to manifest

* term was defined around line 111 and then again at line 209, rename the second one
2019-08-29 02:22:28 +02:00
Oliver Gorwits
26dbb714df #630 display full oui vendor 2019-08-18 10:49:57 +01:00
nick n
e65f7b84c8 dbic sync between actual db & our functions/docs (#595) 2019-05-27 12:39:07 +01:00
Oliver Gorwits
af428ddb0d #565 fix netdisco-do when no device param needed 2019-04-24 22:50:54 +01:00
nick n
0f2ce6b055 spelling/wording 2019-04-24 22:17:06 +02:00
nick n
5beed9cb04 wording 2019-04-24 21:50:45 +02:00
Ambroise
c0f260d36c Allow to pass multiple time the -d parameter to perform the discovery of many devices in one command call. (#564) 2019-04-23 13:19:55 +01:00
nick n
fd4752897d netdisco rancid updates (#558)
* typo

* make this a link

* netdisco-rancid-export has been replaced

* rancid worker config

* netdisco-rancid-export now a no-op

* note debugging option
2019-04-05 01:28:30 +02:00
nick n
3e5e7d36cc whitespace cleanup (#547)
* whitespace

* start tbody correctly
2019-03-23 09:28:43 +00:00
Oliver Gorwits
142ddcc394 update netdisco-sshcollector POD 2019-03-20 12:21:39 +00:00
Christian Ramseyer
a97e069788 Improve netdisco-do doc (related to #540)
* mention how to dumpconfig device_auth
* explain ANSI_COLORS_DISABLED
2019-03-16 14:08:07 +01:00
Oliver Gorwits
d44a8f56ea Integrate netdisco-sshcollector into Worker::Plugin architecture (#489) (#535)
* update changes and SNMP::Info dep

* Integrate netdisco-sshcollector into Worker::Plugin architecture (#489)

* Initial integration of sshcollector into Worker::Plugin architecture

 * add NodesBySSH.pm
 * update Build.PL and config.yml to integrate the new module

* Further integration of sshcollector into Worker::Plugin architecture

 * added App::Netdisco::Transport::CLI loosely based on ::SNMP counterpart
 * switched to the more prevalent two-space tabs style
 * removed various TBD items, some new ones

* Further steps to integration of sshcollector into Worker::Plugin architecture

 * cleaned up code
 * added various error handling
 * warning for bin/netdisco-sshcollector deprecation
 * device_auth allows passing master_opts to Net::OpenSSH
 * netdisco-do -D also toggles Net::OpenSSH debug

* Merged NodesBySSH.pm into Nodes.pm

 * see https://github.com/netdisco/netdisco/pull/489#pullrequestreview-205603516

* Further integration of sshcollector into Worker::Plugin architecture

 * add snmp_arpnip_also option to sshcollector device_auth
 * cleanup code

* Remove big TBD: comment from CLI.pm as doc is updated now

* add transport/cli.pm to manifest

* revert some changes to allow simpler merging

* silent exit legacy script unless explicitly requested

* move ssh code into Transport, part one

* rewrite the CLI transport to provide an API

* merge in og-get_external_credentials

Squashed commit of the following:

commit 3fe8f383a7
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon Mar 11 17:07:42 2019 +0000

    add debug lines and tested

commit 3249739e42
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon Mar 11 16:54:11 2019 +0000

    change config name to get_credentials

commit e78558397a
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon Mar 11 16:51:11 2019 +0000

    separate out generic device auth to DeviceAuth module

commit 249f05165f
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Wed Mar 6 18:43:31 2019 +0000

    release 2.040007

commit e3af64df77
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Wed Mar 6 18:42:47 2019 +0000

    #521-redux fix wifi date search

commit 48857ae300
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon Mar 4 12:03:31 2019 +0000

    release 2.040006

commit e09dab5362
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon Mar 4 11:39:12 2019 +0000

    #527 update List::MoreUtils version requirement

commit 6e7de3fff3
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Mon Mar 4 09:59:41 2019 +0000

    release 2.040005

commit 0c98318a45
Author: Oliver Gorwits <oliver@spike.local>
Date:   Mon Mar 4 09:57:18 2019 +0000

    #526 fix discover syntax bug

commit e9efc45182
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 14:56:48 2019 +0000

    release 2.040004

commit 6cdfd80d10
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 14:34:00 2019 +0000

    allow undiscovered neighbors report to use discover_{waps,phones} setting

commit ac381e0802
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 14:13:20 2019 +0000

    #506 was a red herring

commit b83e614c85
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 13:00:36 2019 +0000

    make discover_{phones,waps} work with LLDP capabilities as well

commit 189d234b55
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 12:47:38 2019 +0000

    check discover_no_type and friends earlier on in neighbors list build

commit 9c956466f3
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 12:32:07 2019 +0000

    also update default config for new discover_phones and discover_waps settings

commit 09d29954d2
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 12:26:50 2019 +0000

    #512 fix regression in phone/wap discovery exclusion

commit 2bae91f1b6
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 12:01:34 2019 +0000

    rename match_devicetype() to match_to_setting()

commit 57cb6ddb70
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sun Mar 3 09:19:39 2019 +0000

    fix for over-eager fix to #506

commit ef560fb59a
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 22:41:40 2019 +0000

    #506 relax device renumber so it works for an alias

commit 7a8bcb094e
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 22:23:39 2019 +0000

    #521 Search Node Date Range not working

commit a643820a62
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 21:54:27 2019 +0000

    #428 Port-Channels not showing in netmap

commit 5ba5bcd295
Merge: e7aacddb a1f95028
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 20:04:11 2019 +0000

    Merge branch 'master' of github.com:netdisco/netdisco

commit e7aacddbc6
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 20:01:05 2019 +0000

    #498 Map with VLAN filter omits unconnected devices

commit a1f95028ca
Author: nick n <39005454+inphobia@users.noreply.github.com>
Date:   Sat Mar 2 19:54:22 2019 +0100

    catch up with changes

    noticed that rc-sshcollector-core received updates to changes, add them here as well.

    didn't mention #499 & #522

commit ce1b847cea
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 18:47:44 2019 +0000

    fix bug showing no nodes when only one matches in netmap

commit 78e30a7926
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 16:28:15 2019 +0000

    #500 filtering in device/ports on native vlan duplicates entries

commit 9952f0c6c7
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 15:02:12 2019 +0000

    #499 netdisco-do renumber reports wrong ip (inphobia)

commit ca3fd8f466
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 15:00:18 2019 +0000

    #505 device renumber should update device port properties and device skips

commit 1265bc8470
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 14:52:21 2019 +0000

    #520 catch slave ports defined without a master

commit d4c7579c10
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 14:47:49 2019 +0000

    #522 TypeAhead.pm can reference empty data (inphobia)

commit 77decc23b7
Author: Oliver Gorwits <oliver@cpan.org>
Date:   Sat Mar 2 14:45:37 2019 +0000

    #514 inconsistent results in ip inventory (inphobia)

commit 3f211650b8
Author: nick n <39005454+inphobia@users.noreply.github.com>
Date:   Fri Mar 1 12:34:42 2019 +0100

    last pieces for db schema upgrade

    last piece of #510

* import legacy sshcollector config

* add default use_legacy_sshcollector config

* remove unneeded deps

* various fixes and now tested

* enable sshcollector platform tests
2019-03-12 18:50:24 +00:00
nick n
89b8f8c0ce allow snmp::info base class in netdisco-do (#486)
* allow the use of base snmp::info

* dont use .

* should have been: dont use $_

* also document some extra features

* reword
2019-01-14 22:02:08 +00:00
inphobia
1ff34c39e6 correct public key documentation
whitespace cleanup (now passes podchecker)
openssh is also required
reference config file with F<>
2019-01-01 17:37:52 +01:00
Christian Ramseyer
b1ca1b968d Improve netdisco-sshcollector CLI experience (#460)
* Improve netdisco-sshcollector CLI experience

 * add -d <device>
 * add -O debug option to toggle Net::OpenSSH::debug
 * add -w MCE::Loop max_workers
 * updated POD for all of the above

* Fix -Q documentation

 * Specifying -Q multiple times has no effect, removed part talking about that.

* Emit Net::OpenSSH connection failures as warnings
2018-12-28 15:58:32 +00:00
nick n
e94f15dc8a typo (paramter instead of parameter)
typo (paramter instead of parameter)
2018-12-13 22:42:52 +01:00
nick n
2e0965033a remove reference to netdisco user in command examples. (#451) 2018-11-27 11:19:22 +00:00
Oliver Gorwits
fb3ef12854 in fact localtime is correct if server admin runs server in GMT
Revert "#441 change localtime to gmtime"

This reverts commit 779e0a618d.
2018-10-19 15:08:38 +01:00
Oliver Gorwits
1baa6dacc6 #435 netdisco-deploy allows blank admin password 2018-10-19 15:06:58 +01:00
Oliver Gorwits
2818591462 #431 sshcollector calls die() even if all the work is not done - stromsoe 2018-10-19 14:59:32 +01:00
Oliver Gorwits
d4b79f685b #433 add status note when updating stats in netdisco-deploy - jrbinks 2018-10-19 14:53:01 +01:00
Oliver Gorwits
0e9274467d #434 shuffle input array for sshcollector - stromsoe 2018-10-19 14:50:54 +01:00
Oliver Gorwits
779e0a618d #441 change localtime to gmtime 2018-10-19 14:49:03 +01:00
Oliver Gorwits
662c24c5b5 limit cli max hosts in prefix to 512 2018-06-07 21:57:16 +01:00
Oliver Gorwits
596d2454d6 fix bug in reuse of $worker for prefix actions 2018-06-07 21:50:43 +01:00
Brian De Wolf
788d3ac26b dump sshcollector stderr into null (#396)
If SSH prints anything to stderr, it leaks out to the caller of sshcollect.
This change dumps it into /dev/null instead.
2018-04-28 11:43:39 +01:00
Oliver Gorwits
2caae8a642 clean up check_mac() interface (ml-cms) 2018-04-18 19:24:08 +01:00
Brian De Wolf
bebaaba626 fix sshcollector errors when devices are empty (#391)
While setting up an sshcollector, I found that the script doesn't handle an
arpless device very gracefully.  The log looks like:

	[46567] 2018-04-10 16:59:08  warn WARNING: no entries received from <IP>
	Can't use string ("1") as an ARRAY ref while "strict refs" in use at perl5/bin/netdisco-sshcollector line 114, <__ANONIO__> line 3.

This is fixed by making the process function always return the expected
structure, even if it's empty.  After this error, the following errors showed
up:

	[53232] 2018-04-10 17:06:15  warn WARNING: no entries received from <IP>
	[53210] 2018-04-10 17:06:15  info  [134.71.0.126] arpnip - retrieved 0 entries
	Use of uninitialized value in sprintf at perl5/bin/netdisco-sshcollector line 119, <__ANONIO__> line 3.
	[53210] 2018-04-10 17:06:15  info arpnip - processed  ARP Cache entries from 1 devices

This is because $stats{entry} only becomes an integer by being incremented, so
if there aren't any entries, it never exists.  This is fixed by starting it at 0.
2018-04-10 21:12:20 +01:00
Oliver Gorwits
83752aff2c use bulk insert for bulk enqueue jobs 2018-02-23 07:41:33 +00:00
Oliver Gorwits
e67c20b78e change q to enqueue and add quiet 2018-02-22 22:22:09 +00:00
Oliver Gorwits
febb2b095e support for enqueue only netdisco-do 2018-02-22 21:54:17 +00:00
Oliver Gorwits
3bb11c426b New MakeRancidConf worker (and makerancidconf action) 2018-01-31 19:59:17 +00:00
Oliver Gorwits
01d795c381 #368 ND2_DB_ROLLBACK environment variable to roll back job updates to DB [skip ci] 2018-01-31 14:54:31 +00:00
Oliver Gorwits
7d63652cac copy default config file into place if necessary 2018-01-21 13:03:42 +00:00
Oliver Gorwits
6c4988a3a2 use new release filename for netdisco-mibs 2018-01-02 14:27:32 +00:00
Oliver Gorwits
9c60727c9f Allow default schedule items to be skipped by setting to 'null' 2017-12-21 20:05:46 +00:00
Oliver Gorwits
c8806beaca cleaner way to update stats after deploy 2017-12-16 10:51:28 +00:00
Oliver Gorwits
bab7fab50a improve netdisco-do docs 2017-12-14 22:04:54 +00:00
Oliver Gorwits
0ed978d3fc improve netdisco-do docs 2017-12-14 22:02:53 +00:00
Oliver Gorwits
242148acdb Also update stats on running netdisco-deploy 2017-12-14 21:56:21 +00:00
Oliver Gorwits
fc4bfa8628 fix sshcollector 2017-12-14 21:42:01 +00:00