• Stars
    star
    170
  • Rank 223,357 (Top 5 %)
  • Language
    Python
  • License
    BSD 3-Clause "New...
  • Created over 7 years ago
  • Updated about 1 month ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Network topology collector and visualizer. Collects network topology data from dynamic mesh routing protocols or other popular networking software like OpenVPN, allows to visualize the network graph, save daily snapshots that can be viewed in the future and more.

openwisp-network-topology

CI build status Test Coverage Dependency monitoring chat Pypi Version downloads code style: black

Features Highlights

Need a quick overview? Try the OpenWISP Demo.

OpenWISP Network Topology is a network topology collector and visualizer web application and API, it allows to collect network topology data from different networking software (dynamic mesh routing protocols, OpenVPN), store it, visualize it, edit its details, it also provides hooks (a.k.a Django signals) to execute code when the status of a link changes.

When used in conjunction with OpenWISP Controller and OpenWISP Monitoring, it makes the monitoring system faster in detecting change to the network.

OpenWISP is not only an application designed for end users, but can also be used as a framework on which custom network automation solutions can be built on top of its building blocks.

Other popular building blocks that are part of the OpenWISP ecosystem are:

  • openwisp-controller: network and WiFi controller: provisioning, configuration management, x509 PKI management and more; works on OpenWRT, but designed to work also on other systems.
  • openwisp-monitoring: provides device status monitoring, collection of metrics, charts, alerts, possibility to define custom checks
  • openwisp-firmware-upgrader: automated firmware upgrades (single device or mass network upgrades)
  • openwisp-radius: based on FreeRADIUS, allows to implement network access authentication systems like 802.1x WPA2 Enterprise, captive portal authentication, Hotspot 2.0 (802.11u)
  • openwisp-ipam: it allows to manage the IP address space of networks

For a more complete overview of the OpenWISP modules and architecture, see the OpenWISP Architecture Overview.

OpenWISP

Want to help OpenWISP? Find out how to help us grow here.


Table of Contents:


Available features

  • network topology collector supporting different formats:
    • NetJSON NetworkGraph
    • OLSR (jsoninfo/txtinfo)
    • batman-adv (jsondoc/txtinfo)
    • BMX6 (q6m)
    • CNML 1.0
    • OpenVPN
    • Wireguard
    • additional formats can be added by writing custom netdiff parsers
  • network topology visualizer based on netjsongraph.js
  • REST API that exposes data in NetJSON NetworkGraph format
  • admin interface that allows to easily manage, audit, visualize and debug topologies and their relative data (nodes, links)
  • RECEIVE network topology data from multiple nodes
  • topology history: allows saving daily snapshots of each topology that can be viewed in the frontend
  • faster monitoring: integrates with OpenWISP Controller and OpenWISP Monitoring for faster detection of critical events in the network

Installation instructions

Deploy it in production

An automated installer is provided by the OpenWISP project: ansible-openwisp2.

Ensure to follow the instructions explained in the following section: Enabling the network topology module.

Install stable version from pypi

Install from pypi:

pip install openwisp-network-topology

Install development version

Install tarball:

pip install https://github.com/openwisp/openwisp-network-topology/tarball/master

Alternatively you can install via pip using git:

pip install -e git+git://github.com/openwisp/openwisp-network-topology#egg=openwisp-network-topology

If you want to contribute, install your cloned fork:

git clone [email protected]:<your_fork>/openwisp-network-topology.git
cd openwisp-network-topology
python setup.py develop

Installing for development

Install sqlite:

sudo apt install -y sqlite3 libsqlite3-dev
# Install system dependencies for spatialite which is required
# to run tests for openwisp-network-topology integrations with
# openwisp-controller and openwisp-monitoring.
sudo apt install libspatialite-dev libsqlite3-mod-spatialite

Install your forked repo:

git clone git://github.com/<your_fork>/openwisp-network-topology
cd openwisp-network-topology/
python setup.py develop

Start InfluxDB and Redis using Docker (required by the test project to run tests for WiFi Mesh Integration):

docker-compose up -d influxdb redis

Install test requirements:

pip install -r requirements-test.txt

Create database:

cd tests/
./manage.py migrate
./manage.py createsuperuser

You can access the admin interface at http://127.0.0.1:8000/admin/.

Run tests with:

# Running tests without setting the "WIFI_MESH" environment
# variable will not run tests for WiFi Mesh integration.
# This is done to avoid slowing down the test suite by adding
# dependencies which are only used by the integration.
./runtests.py
# You can run the tests only for WiFi mesh integration using
# the following command
WIFI_MESH=1 ./runtests.py

Run qa tests:

./run-qa-checks

Setup (integrate in an existing django project)

Add openwisp_network_topology and its dependencies to INSTALLED_APPS:

INSTALLED_APPS = [
    # other apps
    'openwisp_network_topology',
    'openwisp_users.accounts',
    'allauth',
    'allauth.account',
    'openwisp_users',
    'rest_framework',
]

Add the URLs to your main urls.py:

from django.contrib import admin

urlpatterns = [
    # ... other urls in your project ...
    path('', include('openwisp_network_topology.urls')),
    path('admin/', admin.site.urls),
]

Then run:

./manage.py migrate

Quickstart Guide

This module works by periodically collecting the network topology graph data of the supported networking software or formats. The data has to be either fetched by the application or received in POST API requests, therefore after deploying the application, additional steps are required to make the data collection and visualization work, read on to find out how.

Creating a topology

https://github.com/openwisp/openwisp-network-topology/raw/docs/docs/quickstart-topology.gif

  1. Create a topology object by going to Network Topology > Topologies > Add topology.
  2. Give an appropriate label to the topology.
  3. Select the topology format from the dropdown menu. The topology format determines which parser should be used to process topology data.
  4. Select the Strategy for updating this topology.
    • If you are using FETCH strategy, then enter the URL for fetching topology data in the Url field.
    • If you are using RECEIVE strategy, you will get the URL for sending topology data. The RECEIVE strategy provides an additional field expiration time. This can be used to add delay in marking missing links as down.

Sending data for topology with RECEIVE strategy

https://github.com/openwisp/openwisp-network-topology/raw/docs/docs/quickstart-receive.gif

  1. Copy the URL generated by OpenWISP for sending the topology data.

    E.g., in our case the URL is http://127.0.0.1:8000/api/v1/network-topology/topology/d17e539a-1793-4be2-80a4-c305eca64fd8/receive/?key=cMGsvio8q0L0BGLd5twiFHQOqIEKI423.

    Note: The topology receive URL is shown only after the topology object is created.

  2. Create a script (eg: /opt/send-topology.sh) which sends the topology data using POST, in the example script below we are sending the status log data of OpenVPN but the same code can be applied to other formats by replacing cat /var/log/openvpn/tun0.stats with the actual command which returns the network topology output:

#!/bin/bash
# replace COMMAND with the command used to fetch the topology data
COMMAND="cat /var/log/openvpn/tun0.stats"
UUID="<TOPOLOGY-UUID-HERE>"
KEY="<TOPOLOGY-KEY-HERE>"
OPENWISP_URL="https://<OPENWISP_DOMAIN_HERE>"
$COMMAND |
    # Upload the topology data to OpenWISP
    curl -X POST \
        --data-binary @- \
        --header "Content-Type: text/plain" \
        $OPENWISP_URL/api/v1/network-topology/topology/$UUID/receive/?key=$KEY
  1. Add the /opt/send-topology.sh script created in the previous step to the crontab, here's an example which sends the topology data every 5 minutes:
# flag script as executable
chmod +x /opt/send-topology.sh
# open crontab
crontab -e

## Add the following line and save

echo */5 * * * * /opt/send-topology.sh
  1. Once the steps above are completed, you should see nodes and links being created automatically, you can see the network topology graph from the admin page of the topology change page (you have to click on the View topology graph button in the upper right part of the page) or, alternatively, a non-admin visualizer page is also available at the URL /topology/topology/<TOPOLOGY-UUID>/.

Management Commands

update_topology

After topology URLs (URLs exposing the files that the topology of the network) have been added in the admin, the update_topology management command can be used to collect data and start playing with the network graph:

./manage.py update_topology

The management command accepts a --label argument that will be used to search in topology labels, eg:

./manage.py update_topology --label mytopology

save_snapshot

The save_snapshot management command can be used to save the topology graph data which could be used to view the network topology graph sometime in future:

./manage.py save_snapshot

The management command accepts a --label argument that will be used to search in topology labels, eg:

./manage.py save_snapshot --label mytopology

upgrade_from_django_netjsongraph

If you are upgrading from django-netjsongraph to openwisp-network-topology, there is an easy migration script that will import your topologies, users & groups to openwisp-network-topology instance:

./manage.py upgrade_from_django_netjsongraph

The management command accepts an argument --backup, that you can pass to give the location of the backup files, by default it looks in the tests/ directory, eg:

./manage.py upgrade_from_django_netjsongraph --backup /home/user/django_netjsongraph/

The management command accepts another argument --organization, if you want to import data to a specific organization, you can give its UUID for the same, by default the data is added to the first found organization, eg:

./manage.py upgrade_from_django_netjsongraph --organization 900856da-c89a-412d-8fee-45a9c763ca0b

Note: you can follow the tutorial to migrate database from django-netjsongraph.

create_device_nodes

This management command can be used to create the initial DeviceNode relationships when the integration with OpenWISP Controller is enabled in a pre-existing system which already has some devices and topology objects in its database.

./manage.py create_device_nodes

Logging

The update_topology management command will automatically try to log errors.

For a good default LOGGING configuration refer to the test settings.

Strategies

There are mainly two ways of collecting topology information:

  • FETCH strategy
  • RECEIVE strategy

Each Topology instance has a strategy field which can be set to the desired setting.

FETCH strategy

Topology data will be fetched from a URL.

When some links are not detected anymore they will be flagged as "down" straightaway.

RECEIVE strategy

Topology data is sent directly from one or more nodes of the network.

The collector waits to receive data in the payload of a POST HTTP request; when such a request is received, a key parameter it's first checked against the Topology key.

If the request is authorized the collector proceeds to update the topology.

If the data is sent from one node only, it's highly advised to set the expiration_time of the Topology instance to 0 (seconds), this way the system works just like in the FETCH strategy, with the only difference that the data is sent by one node instead of fetched by the collector.

If the data is sent from multiple nodes, you SHOULD set the expiration_time of the Topology instance to a value slightly higher than the interval used by nodes to send the topology, this way links will be flagged as "down" only if they haven't been detected for a while. This mechanism allows to visualize the topology even if the network has been split in several parts, the disadvantage is that it will take a bit more time to detect links that go offline.

Integration with OpenWISP Controller and OpenWISP Monitoring

If you use OpenWISP Controller or OpenWISP Monitoring and you use OpenVPN or Wireguard for the management VPN, you can use the integration available in openwisp_network_topology.integrations.device.

This additional and optional module provides the following features:

  • whenever the status of a link changes:
    • the management IP address of the related device is updated straightaway
    • if OpenWISP Monitoring is enabled, the device checks are triggered (e.g.: ping)
  • if OpenWISP Monitoring is installed and enabled, the system can automatically create topology for the WiFi Mesh (802.11s) interfaces using the monitoring data provided by the agent. You can enable this by setting OPENWISP_NETWORK_TOPOLOGY_WIFI_MESH_INTEGRATION to True.

This integration makes the whole system a lot faster in detecting important events in the network.

In order to use this module simply add openwisp_network_topology.integrations.device to INSTALLED_APPS:

INSTALLED_APPS = [
    # other apps (eg: openwisp-controller, openwisp-monitoring)
    'openwisp_network_topology',
    'openwisp_network_topology.integrations.device',
    'openwisp_users.accounts',
    'allauth',
    'allauth.account',
    'openwisp_users',
    'rest_framework',
]

If you have enabled WiFI Mesh integration, you will also need to update the CELERY_BEAT_SCHEDULE as follow:

CELERY_BEAT_SCHEDULE = {
    'create_mesh_topology': {
        # This task generates the mesh topology from monitoring data
        'task': 'openwisp_network_topology.integrations.device.tasks.create_mesh_topology',
        # Execute this task every 5 minutes
        'schedule': timedelta(minutes=5),
        'args': (
            # List of organization UUIDs. The mesh topology will be
            # created only for devices belonging these organizations.
            [
                '4e002f97-eb01-4371-a4a8-857faa22fe5c',
                'be88d4c4-599a-4ca2-a1c0-3839b4fdc315'
            ],
            # The task won't use monitoring data reported
            # before this time (in seconds)
            6 * 60 # 6 minutes
        ),
    },
}

If you are enabling this integration on a pre-existing system, use the create_device_nodes management command to create the relationship between devices and nodes.

Settings

OPENWISP_NETWORK_TOPOLOGY_PARSERS

type: list
default: []

Additional custom netdiff parsers.

OPENWISP_NETWORK_TOPOLOGY_SIGNALS

type: str
default: None

String representing python module to import on initialization.

Useful for loading django signals or to define custom behaviour.

OPENWISP_NETWORK_TOPOLOGY_TIMEOUT

type: int
default: 8

Timeout when fetching topology URLs.

OPENWISP_NETWORK_TOPOLOGY_LINK_EXPIRATION

type: int
default: 60

If a link is down for more days than this number, it will be deleted by the update_topology management command.

Setting this to False will disable this feature.

OPENWISP_NETWORK_TOPOLOGY_NODE_EXPIRATION

type: int
default: False

If a node has not been modified since the days specified and if it has no links, it will be deleted by the update_topology management command. This depends on OPENWISP_NETWORK_TOPOLOGY_LINK_EXPIRATION being enabled. Replace False with an integer to enable the feature.

OPENWISP_NETWORK_TOPOLOGY_VISUALIZER_CSS

type: str
default: netjsongraph/css/style.css

Path of the visualizer css file. Allows customization of css according to user's preferences.

OPENWISP_NETWORK_TOPOLOGY_API_URLCONF

type: string
default: None

Use the urlconf option to change receive api url to point to another module, example, myapp.urls.

OPENWISP_NETWORK_TOPOLOGY_API_BASEURL

type: string
default: None

If you have a seperate instance of openwisp-network-topology on a different domain, you can use this option to change the base of the url, this will enable you to point all the API urls to your openwisp-network-topology API server's domain, example value: https://mytopology.myapp.com.

OPENWISP_NETWORK_TOPOLOGY_API_AUTH_REQUIRED

type: boolean
default: True

When enabled, the API endpoints will only allow authenticated users who have the necessary permissions to access the objects which belong to the organizations the user manages.

OPENWISP_NETWORK_TOPOLOGY_WIFI_MESH_INTEGRATION

type: boolean
default: False

When enabled, network topology objects will be automatically created and updated based on the WiFi mesh interfaces peer information supplied by the monitoring agent.

Note: The network topology objects are created using the device monitoring data collected by OpenWISP Monitoring. Thus, it requires integration with OpenWISP Controller and OpenWISP Monitoring to be enabled in the Django project.

Rest API

Live documentation

https://github.com/openwisp/openwisp-network-topology/raw/docs/docs/api-doc.png

A general live API documentation (following the OpenAPI specification) at /api/v1/docs/.

Browsable web interface

https://github.com/openwisp/openwisp-network-topology/raw/docs/docs/api-ui.png

Additionally, opening any of the endpoints listed below directly in the browser will show the browsable API interface of Django-REST-Framework, which makes it even easier to find out the details of each endpoint.

List of endpoints

Since the detailed explanation is contained in the Live documentation and in the Browsable web page of each point, here we'll provide just a list of the available endpoints, for further information please open the URL of the endpoint in your browser.

List topologies

GET /api/v1/network-topology/topology/

Available filters:

  • strategy: Filter topologies based on their strategy (fetch or receive). E.g. ?strategy=<topology_strategy>.
  • parser: Filter topologies based on their parser. E.g. ?parser=<topology_parsers>.
  • organization: Filter topologies based on their organization. E.g. ?organization=<topology_organization_id>.
  • organization_slug: Filter topologies based on their organization slug. E.g. ?organization_slug=<topology_organization_slug>.

You can use multiple filters in one request, e.g.:

/api/v1/network-topology/topology/?organization=371791ec-e3fe-4c9a-8972-3e8b882416f6&strategy=fetch

Note: By default, /api/v1/network-topology/topology/ does not include unpublished topologies. If you want to include unpublished topologies in the response, use ?include_unpublished=true filter as following:

GET /api/v1/network-topology/topology/?include_unpublished=true

Create topology

POST /api/v1/network-topology/topology/

Detail of a topology

GET /api/v1/network-topology/topology/{id}/

Note: By default, /api/v1/network-topology/topology/{id}/ will return HTTP 404 Not Found for unpublished topologies. If you want to retrieve an unpublished topology, use ?include_unpublished=true filter as following:

GET /api/v1/network-topology/topology/{id}/?include_unpublished=true

Change topolgy detail

PUT /api/v1/network-topology/topology/{id}/

Patch topology detail

PATCH /api/v1/network-topology/topology/{id}/

Delete topology

DELETE /api/v1/network-topology/topology/{id}/

View topology history

This endpoint is used to go back in time to view previous topology snapshots. For it to work, snapshots need to be saved periodically as described in save_snapshot section above.

For example, we could use the endpoint to view the snapshot of a topology saved on 2020-08-08 as follows.

GET /api/v1/network-topology/topology/{id}/history/?date=2020-08-08

Send topology data

POST /api/v1/network-topology/topology/{id}/receive/

List links

GET /api/v1/network-topology/link/

Available filters:

  • topology: Filter links belonging to a topology. E.g. ?topology=<topology_id>.
  • organization: Filter links belonging to an organization. E.g. ?organization=<organization_id>.
  • organization_slug: Filter links based on their organization slug. E.g. ?organization_slug=<organization_slug>.
  • status: Filter links based on their status (up or down). E.g. ?status=<link_status>.

You can use multiple filters in one request, e.g.:

/api/v1/network-topology/link/?status=down&topology=7fce01bd-29c0-48b1-8fce-0508f2d75d36

Create link

POST /api/v1/network-topology/link/

Get link detail

GET /api/v1/network-topology/link/{id}/

Change link detail

PUT /api/v1/network-topology/link/{id}/

Patch link detail

PATCH /api/v1/network-topology/link/{id}/

Delete link

DELETE /api/v1/network-topology/link/{id}/

List nodes

GET /api/v1/network-topology/node/

Available filters:

  • topology: Filter nodes belonging to a topology. E.g. ?topology=<topology_id>.
  • organization: Filter nodes belonging to an organization. E.g. ?organization=<organization_id>.
  • organization_slug: Filter nodes based on their organization slug. E.g. ?organization_slug=<organization_slug>.

You can use multiple filters in one request, e.g.:

/api/v1/network-topology/node/?organization=371791ec-e3fe-4c9a-8972-3e8b882416f6&topology=7fce01bd-29c0-48b1-8fce-0508f2d75d36

Create node

POST /api/v1/network-topology/node/

Get node detail

GET /api/v1/network-topology/node/{id}/

Change node detail

PUT /api/v1/network-topology/node/{id}/

Patch node detail

PATCH /api/v1/network-topology/node/{id}/

Delete node

DELETE /api/v1/network-topology/node/{id}/

Overriding visualizer templates

Follow these steps to override and customise the visualizer's default templates:

  • create a directory in your django project and put its full path in TEMPLATES['DIRS'], which can be found in the django settings.py file
  • create a sub directory named netjsongraph and add all the templates which shall override the default netjsongraph/* templates
  • create a template file with the same name of the template file you want to override

More information about the syntax used in django templates can be found in the django templates documentation.

Example: overriding the <script> tag

Here's a step by step guide on how to change the javascript options passed to netjsongraph.js, remember to replace <project_path> with the absolute filesytem path of your project.

Step 1: create a directory in <project_path>/templates/netjsongraph

Step 2: open your settings.py and edit the TEMPLATES['DIRS'] setting so that it looks like the following example:

# settings.py
TEMPLATES = [
    {
        'DIRS': [os.path.join(BASE_DIR, 'templates')],
        # ... all other lines have been omitted for brevity ...
    }
]

Step 3: create a new file named netjsongraph-script.html in the new <project_path>/templates/netjsongraph/ directory, eg:

<!-- <project_path>/templates/netjsongraph/netjsongraph-script.html -->
<script>
    window.__njg_el__ = window.__njg_el__ || "body";
    window.__njg_default_url__ = "{{ graph_url }}";
    window.loadNetJsonGraph = function(graph){
        graph = graph || window.__njg_default_url__;
        d3.select("svg").remove();
        d3.select(".njg-overlay").remove();
        d3.select(".njg-metadata").remove();
        return d3.netJsonGraph(graph, {
            el: window.__njg_el__,
            // customizations of netjsongraph.js
            linkClassProperty: "status",
            defaultStyle: false,
            labelDy: "-1.4em",
            circleRadius: 8,
            charge: -100,
            gravity: 0.3,
            linkDistance: 100,
            linkStrength: 0.2,
        });
    };
    window.graph = window.loadNetJsonGraph();
    window.initTopologyHistory(jQuery);
</script>

Extending openwisp-network-topology

One of the core values of the OpenWISP project is Software Reusability, for this reason openwisp-network-topology provides a set of base classes which can be imported, extended and reused to create derivative apps.

In order to implement your custom version of openwisp-network-topology, you need to perform the steps described in this section.

When in doubt, the code in the test project and the sample app will serve you as source of truth: just replicate and adapt that code to get a basic derivative of openwisp-network-topology working.

Premise: if you plan on using a customized version of this module, we suggest to start with it since the beginning, because migrating your data from the default module to your extended version may be time consuming.

1. Initialize your custom module

The first thing you need to do is to create a new django app which will contain your custom version of openwisp-network-topology.

A django app is nothing more than a python package (a directory of python scripts), in the following examples we'll call this django app sample_network_topology, but you can name it how you want:

django-admin startapp sample_network_topology

If you use the integration with openwisp-controller, you may want to extend also the integration app if you need:

django-admin startapp sample_integration_device

Keep in mind that the command mentioned above must be called from a directory which is available in your PYTHON_PATH so that you can then import the result into your project.

Now you need to add sample_network_topology to INSTALLED_APPS in your settings.py, ensuring also that openwisp_network_topology has been removed:

INSTALLED_APPS = [
    # ... other apps ...
    'openwisp_utils.admin_theme',
    # all-auth
    'django.contrib.sites',
    'openwisp_users.accounts',
    'allauth',
    'allauth.account',
    'allauth.socialaccount',
    # (optional) openwisp_controller - required only if you are using the integration app
    'openwisp_controller.pki',
    'openwisp_controller.config',
    'reversion',
    'sortedm2m',
    # network topology
    # 'sample_network_topology' <-- uncomment and replace with your app-name here
    # (optional) required only if you need to extend the integration app
    # 'sample_integration_device' <-- uncomment and replace with your integration-app-name here
    'openwisp_users',
    # admin
    'django.contrib.admin',
    # rest framework
    'rest_framework',
]

For more information about how to work with django projects and django apps, please refer to the django documentation.

2. Install openwisp-network-topology

Install (and add to the requirement of your project) openwisp-network-topology:

pip install openwisp-network-topology

3. Add EXTENDED_APPS

Add the following to your settings.py:

EXTENDED_APPS = ('openwisp_network_topology',)

4. Add openwisp_utils.staticfiles.DependencyFinder

Add openwisp_utils.staticfiles.DependencyFinder to STATICFILES_FINDERS in your settings.py:

STATICFILES_FINDERS = [
    'django.contrib.staticfiles.finders.FileSystemFinder',
    'django.contrib.staticfiles.finders.AppDirectoriesFinder',
    'openwisp_utils.staticfiles.DependencyFinder',
]

5. Add openwisp_utils.loaders.DependencyLoader

Add openwisp_utils.loaders.DependencyLoader to TEMPLATES in your settings.py:

TEMPLATES = [
    {
        'BACKEND': 'django.template.backends.django.DjangoTemplates',
        'OPTIONS': {
            'loaders': [
                'django.template.loaders.filesystem.Loader',
                'django.template.loaders.app_directories.Loader',
                'openwisp_utils.loaders.DependencyLoader',
            ],
            'context_processors': [
                'django.template.context_processors.debug',
                'django.template.context_processors.request',
                'django.contrib.auth.context_processors.auth',
                'django.contrib.messages.context_processors.messages',
            ],
        },
    }
]

6. Inherit the AppConfig class

Please refer to the following files in the sample app of the test project:

For the integration with openwisp-controller, see:

You have to replicate and adapt that code in your project.

For more information regarding the concept of AppConfig please refer to the "Applications" section in the django documentation.

7. Create your custom models

Please refer to sample_app models file use in the test project.

You have to replicate and adapt that code in your project.

Note: for doubts regarding how to use, extend or develop models please refer to the "Models" section in the django documentation.

8. Add swapper configurations

Once you have created the models, add the following to your settings.py:

# Setting models for swapper module
TOPOLOGY_LINK_MODEL = 'sample_network_topology.Link'
TOPOLOGY_NODE_MODEL = 'sample_network_topology.Node'
TOPOLOGY_SNAPSHOT_MODEL = 'sample_network_topology.Snapshot'
TOPOLOGY_TOPOLOGY_MODEL = 'sample_network_topology.Topology'
# if you use the integration with OpenWISP Controller and/or OpenWISP Monitoring
TOPOLOGY_DEVICE_DEVICENODE_MODEL = 'sample_integration_device.DeviceNode'
TOPOLOGY_DEVICE_WIFIMESH_MODEL = 'sample_integration_device.WifiMesh'

Substitute sample_network_topology with the name you chose in step 1.

9. Create database migrations

Create and apply database migrations:

./manage.py makemigrations
./manage.py migrate

For more information, refer to the "Migrations" section in the django documentation.

10. Create the admin

Refer to the admin.py file of the sample app.

To introduce changes to the admin, you can do it in two main ways which are described below.

Note: for more information regarding how the django admin works, or how it can be customized, please refer to "The django admin site" section in the django documentation.

1. Monkey patching

If the changes you need to add are relatively small, you can resort to monkey patching.

For example:

from openwisp_network_topology.admin import TopologyAdmin, LinkAdmin, NodeAdmin

# TopologyAdmin.list_display.insert(1, 'my_custom_field') <-- your custom change example
# LinkAdmin.list_display.insert(1, 'my_custom_field') <-- your custom change example
# NodeAdmin.list_display.insert(1, 'my_custom_field') <-- your custom change example

2. Inheriting admin classes

If you need to introduce significant changes and/or you don't want to resort to monkey patching, you can proceed as follows:

from django.contrib import admin
from swapper import load_model

from openwisp_network_topology.admin import (
    TopologyAdmin as BaseTopologyAdmin,
    LinkAdmin as BaseLinkAdmin,
    NodeAdmin as BaseNodeAdmin
)

Node = load_model('topology', 'Node')
Link = load_model('topology', 'Link')
Topology = load_model('topology', 'Topology')

admin.site.unregister(Topology)
admin.site.unregister(Link)
admin.site.unregister(Node)

@admin.register(Topology, TopologyAdmin)
class TopologyAdmin(BaseTopologyAdmin):
    # add your changes here

@admin.register(Link, LinkAdmin)
class LinkAdmin(BaseLinkAdmin):
    # add your changes here

@admin.register(Node, NodeAdmin)
class NodeAdmin(BaseNodeAdmin):
    # add your changes here

11. Create root URL configuration

Please read and replicate according to your project needs:

The following can be used to register all the urls in your
``urls.py``.

# If you've extended visualizer views (discussed below).
# Import visualizer views & function to add it.
# from openwisp_network_topology.utils import get_visualizer_urls
# from .sample_network_topology.visualizer import views

urlpatterns = [
    # If you've extended visualizer views (discussed below).
    # Add visualizer views in urls.py
    # path('topology/', include(get_visualizer_urls(views))),
    path('', include('openwisp_network_topology.urls')),
    path('admin/', admin.site.urls),
]

For more information about URL configuration in django, please refer to the "URL dispatcher" section in the django documentation.

12. Setup API urls

You need to create a file api/urls.py (the name & path of the file must match) inside your app, which contains the following:

from openwisp_network_topology.api import views
# When you want to modify views, please change views location
# from . import views
from openwisp_network_topology.utils import get_api_urls

urlpatterns = get_api_urls(views)

13. Extending management commands

To extend the management commands, create sample_network_topology/management/commands directory and two files in it:

14. Import the automated tests

When developing a custom application based on this module, it's a good idea to import and run the base tests too, so that you can be sure the changes you're introducing are not breaking some of the existing features of openwisp-network-topology.

Refer to the tests.py file of the sample app.

In case you need to add breaking changes, you can overwrite the tests defined in the base classes to test your own behavior.

For testing you also need to extend the fixtures, you can copy the file openwisp_network_topology/fixtures/test_users.json in your sample app's fixtures/ directory.

Now, you can then run tests with:

# the --parallel flag is optional
./manage.py test --parallel sample_network_topology

Substitute sample_network_topology with the name you chose in step 1.

For more information about automated tests in django, please refer to "Testing in Django".

Other base classes that can be inherited and extended

The following steps are not required and are intended for more advanced customization.

1. Extending API views

Extending the views is only required when you want to make changes in the behaviour of the API. Please refer to sample_network_topology/api/views.py and replicate it in your application.

If you extend these views, remember to use these views in the api/urls.py.

2. Extending the Visualizer views

Similar to API views, visualizer views are only required to be extended when you want to make changes in the Visualizer. Please refer to sample_network_topology/visualizer/views.py and replicate it in your application.

If you extend these views, remember to use these views in the urls.py.

Contributing

Please refer to the OpenWISP contributing guidelines.

Changelog

See CHANGES.

License

See LICENSE.

This projects bundles third-party javascript libraries in its source code:

Support

See OpenWISP Support Channels.

More Repositories

1

django-rest-framework-gis

Geographic add-ons for Django REST Framework. Maintained by the OpenWISP Project.
Python
1,081
star
2

openwisp-controller

Network and WiFi controller: provisioning, configuration management and updates, (pull via openwisp-config or push via SSH), x509 PKI management and more. Mainly OpenWRT, but designed to work also on other systems.
Python
556
star
3

ansible-openwisp2

Ansible role that installs and upgrades OpenWISP.
Python
477
star
4

openwisp-config

OpenWRT configuration agent for OpenWISP Controller
Lua
374
star
5

django-freeradius

Administration web interface and REST API for freeradius 3 build in django & python, development has moved to openwisp-radius
Python
365
star
6

openwisp-radius

Administration web interface and REST API for freeradius 3 build in django & python. Supports captive portal authentication, WPA Enerprise (802.1x), freeradius rlm_rest, social login, Hotspot 2.0 / 802.11u, importing users from CSV, registration of new users and more.
Python
363
star
7

netjsonconfig

Network configuration management library based on NetJSON DeviceConfiguration
Python
359
star
8

django-x509

Reusable django app implementing x509 PKI certificates management
Python
340
star
9

netjsongraph.js

NetJSON NetworkGraph visualizer.
JavaScript
270
star
10

django-netjsonconfig

Configuration manager for embedded devices, implemented as a reusable django-app
JavaScript
194
star
11

django-loci

Reusable Django app for storing geographic and indoor coordinates. Maintained by the OpenWISP Project.
Python
181
star
12

openwisp-monitoring

Network monitoring system written in Python and Django, designed to be extensible, programmable, scalable and easy to use by end users: once the system is configured, monitoring checks, alerts and metric collection happens automatically.
Python
166
star
13

openwisp-users

Implementation of user management and multi-tenancy for OpenWISP
Python
163
star
14

docker-openwisp

OpenWISP in docker. For production usage we recommend using the ansible-openwisp2 role.
Python
153
star
15

django-netjsongraph

Network Topology Visualizer & Network Topology Collector
Python
141
star
16

openwisp-wifi-login-pages

Configurable captive page for public/private WiFi services providing login, sign up, social login, SMS verification, change password, reset password, change phone number and more.
JavaScript
128
star
17

ansible-openwisp2-imagegenerator

Automatically build several openwisp2 firmware images for different organizations while keeping track of their differences
Shell
120
star
18

openwisp-ipam

IP address space administration module of OpenWISP
Python
104
star
19

OpenWISP-Firmware

An OpenWRT based firmware to be used with OpenWISP Manager
Shell
86
star
20

netdiff

Python library for parsing network topology data (e.g.: OpenVPN, Wireguard, ZeroTier, NetJSON, Dynamic Routing Protocols) and detect changes.
Python
80
star
21

django-ipam

The development of this project has moved to openwisp-ipam
Python
78
star
22

openwisp-utils

Python and Django utilities shared between different openwisp modules
Python
74
star
23

django-flat-json-widget

Flat JSON widget for django, used and maintained by the OpenWISP project.
Python
64
star
24

OpenWISP-Captive-Portals-Manager

OWCPM is a captive portal written from scratch with Ruby on Rails.
Ruby
58
star
25

openwisp-firmware-upgrader

Firmware upgrade solution for OpenWRT with possibility to add support for other embedded OSes. Provides features like automatic retry for network failures, mass upgrades, REST API and more.
Python
53
star
26

openwisp-docs

OpenWISP Documentation.
Python
50
star
27

vagrant-openwisp2

Ansible Vagrant profile to install an OpenWISP 2 server
44
star
28

openwisp-notifications

Notifications module of OpenWISP
Python
41
star
29

OpenWISP-User-Management-System

OpenWISP User Management System (OWUMS) is a Ruby on Rails application, capable of managing a WISP's user base.
Ruby
40
star
30

OpenWISP-Website

OpenWISP Project's website
HTML
39
star
31

netengine

Python abstraction layer for extracting information from network devices.
Python
38
star
32

OpenWISP-Manager

The OpenWISP Manager is a RoR web GUI for configuring OpenWISP firmware-based access points.
Ruby
36
star
33

openwrt-openwisp-monitoring

OpenWRT monitoring agent for openwisp-monitoring
Lua
23
star
34

luci-openwisp

OpenWISP configuration interface implemented as LuCI extensions
HTML
20
star
35

django-owm-legacy

OpenWISP Manager backward compatible legacy features implemented in django
Python
17
star
36

OpenWISP-Geographic-Monitoring

A Rails application for managing a wISP's access points
Ruby
15
star
37

coova-chilli-openwrt

Makefile
13
star
38

openwrt-zabbixd

Ucified Zabbix Packages
Makefile
13
star
39

netjsonconfig-editor.js

[GSOC 2017] This project has stalled.
JavaScript
12
star
40

django-jsonschema-widget

JavaScript
11
star
41

OpenWISP-Middle-Ware

A Sinatra application for interconnecting OpenWISP applications via a RESTful API
Ruby
11
star
42

OpenWISP-Puppet-Modules

A set of modules and hacks for the https://openwisp.caspur.it project
HTML
10
star
43

AdaLoveBot-intents

Helping bot of the OpenWISP Chat
JavaScript
9
star
44

ansible-freeitaliawifi-login-page

Standard login page for Free ItaliaWifi federated networks
JavaScript
9
star
45

openwisp-netcheck

Shell
9
star
46

openwisp-template-library-backend

Python
8
star
47

netjson-templates

CSS
6
star
48

ansible-wireguard-openwisp

Python
6
star
49

openwisp-template-library-frontend

GSOC 19
JavaScript
6
star
50

OpenWISP-ETL

Extract Transform Load Module developed with pentaho pdi ce-5.0.1.A
6
star
51

openVPNServer

Ruby
5
star
52

openwrt-feed

DEPRECATED, work moved on OpenWisp-Firmware repo
Shell
5
star
53

ansible-openwisp-wifi-login-pages

Ansible role to deploy and manage OpenWISP WiFi Login Pages
Jinja
5
star
54

lxdock-openwisp2

This repository is only a mirror. If you want to work on it, make a fork on https://gitlab.com/openwisp/lxdock-openwisp2
5
star
55

packet-legacy

packet-legacy
Ruby
4
star
56

ansible-ow-influxdb

4
star
57

OpenWISP-BI

Business Intelligence module developed with pentaho biserver ce-4.8.0
4
star
58

openwisp-sphinx-theme

OpenWISP Sphinx Theme
CSS
3
star
59

openwisp-dev-env

Automated development environment for OpenWISP, work in progress.
3
star
60

openwisp-sentry-utils

Python
2
star
61

ansible-openwisp2-iptables

ansible role containing iptables rules to protect an openwisp2 instance
Shell
2
star