vmware-labs/bert-pretraining

Stars
4
Rank 3,304,323 (Top 66 %)
Language
Python
License
Apache License 2.0
Created over 2 years ago
Updated almost 2 years ago

vmware-labs/bert-pretraining

vmware-labs

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

The project is a python module that facilitates BERT pretraining. The current existing open source solution for training this specific model is convoluted. We have simplified the procedure. The project's goal is to open the code to the wider Machine Learning community to help ML practitioners train their own BERT models using their data. The code was created to train the latest iteration of VMware's BERT model (vBERT) to help Machine Learning and Natural Language Processing Researchers within VMware.

wasm-workers-server

🚀 Develop and run serverless applications on WebAssembly

webassembly-language-runtimes

Wasm Language Runtimes provides popular language runtimes (Ruby, Python, …) precompiled to WebAssembly that are tested for compatibility and kept up to date when new versions of upstream languages are released

attack-surface-framework

Tool to discover external and internal network attack surface

node-replicated-kernel

Experimental kernel with built-in replication.

mod_wasm

mod_wasm is an extension module for the Apache HTTP Server (httpd) that enables the usage of WebAssembly (Wasm). This module allows the execution of certain tasks in the backend in a very efficient and secure way.

reconciler-runtime

⚠️ Maintenance suspended. Please, migrate to the active fork reconciler.io/runtime. See https://github.com/reconcilerio/runtime/releases/tag/v0.20.0 for instructions. This repository will be archived eventually.

distribution-tooling-for-helm

Helm Distribution plugin is is a set of utilities and Helm Plugin for making offline work with Helm Charts easier. It is meant to be used for creating reproducible and relocatable packages for Helm Charts that can be moved around registries without hassles. This is particularly useful for distributing Helm Charts into airgapped environments.

yaml-jsonpath

JSONPath implementation for the gopkg.in/yaml.v3 node API

wasm-languages

How to use WebAssembly in various languages

verified-betrfs

A verified high-performance file system

hci-benchmark-appliance

HCIBench stands for "Hyper-converged Infrastructure Benchmark". It's an automation wrapper around the popular and proven open source benchmark tools: Vdbench and Fio that make it easier to automate testing across a HCI cluster. It's the recommended tool for VMware vSAN customer to run performance testing.

vmware-customer-connect-cli

Golang based CLI to interact with customerconnect.vmware.com

date-and-time-pattern-detection

Date/time Pattern Detection is multi-module project consisting of library, rest-api and models. The project aims to help Engineers who need to parse date/time input without pattern, need validation library for localized date/time or help/suggestions on what are the standard Unicode practices for Localization.

research-and-development-artificial-intelligence-lab

Welcome to VMware's AI Lab (VAIL). Here we publish helpful snippets for the NLP community 😄

vmware-image-builder-action

GitHub action code for VMware Image Builder (VIB).

marketplace-cli

A CLI for interacting with the VMware Marketplace

container-tracer

The project brings the power of the Linux kernel tracing to Kubernetes. It leverages existing kernel tracing frameworks such as ftrace, perf, ebpf to trace workloads running on a Kubernetes cluster. Designed as a native Kubernetes application, its main goal is to be simple and efficient in doing one thing - collecting system traces per container.

advanced-same-machine-interprocess-communication-protocol-suite

Toroni is a protocol suite for advanced interprocess communication specialized to work the same machine (i.e. no networking involved) offering characteristics that are unmatched by existing OS IPC features, off-the shelve components like ZeroMQ, Aeron and many others. Currently Toroni involves The Reliable Message Protocol which is:- brokerless, meaning no dedicated server process is needed to run the protocol- many-to-many- totally ordered, meaning all readers see messages from all writers in the same order- reliable, meaning a reader can detect if it has missed a message- termination safe, meaning crash of any communicating process is not harmful to the restAdditionaly Toroni offers The Topic Protocol (TP) which is is publish/subscribe protocol running on top of RMP.More info about RMP and TP can be found at https://radio.eng.vmware.com/2022/events/3090Toroni will not be limited to RMP and TP and can be placeholder for new advanced IPC same machine protocols.

feed-manager-for-misp

MISP Feed Manager is a set of python libraries and utilities to ease generation and consumption of feeds of threat intelligence indicators published in MISP format (https://github.com/MISP/misp-rfc). MISP Threat Sharing is an open source threat intelligence platform (https://en.wikipedia.org/wiki/Malware_Information_Sharing_Platform).

multi-tenant-persistence-for-saas

Multi-tenant Persistence for SaaS acts as data abstraction layer for underlying data store (Postgres) and provide multi-tenancy capabilities along with ability to integrate with different IAM authorizers.

build-inspector

Build Inspector is a tool designed to process plain-text CI/CD build and deploy logs, and extract useful information from them, such as dependency provenance information, along with potentially risky behavioral information.

client-library-for-chaos-mesh

Chaos-Mesh Python Client

blueprint-for-horizon-with-vmc-on-aws

This script include all necessary groups, services and Distributed firewall rules for a Horizon Environment in VMC on AWS.

vmware-customer-connect-sdk

Golang based SDK to interact with customerconnect.vmware.com. It is used in a CLI that enables product downloads from customerconnect: https://github.com/vmware-labs/vmware-customer-connect-cli

vms-for-slurm

vm-provisioning-plugin-for-slurm (also called Multiverse) is Dynamic VM orchestration for virtualized HPC frameworks. In other words it a VM per job model which spawns individual VMs on demand for evey incoming job in a HPC Cluster.

galaxy-parser-for-misp

MISP Galaxy Parser is a set of python libraries and utilities to ease reading and processing of MISP Galaxies. MISP Galaxies are knowledge bases of malware labels, threat actors codified in MISP format. MISP Threat Sharing is an open source threat intelligence platform (https://en.wikipedia.org/wiki/Malware_Information_Sharing_Platform).

patterns-lab

Run an immutable vmware lab using PhotonOS.

inclusive-language-ext-for-sonarqube

Language and terminology undergo change on a continuous basis due to social and linguistic forces. VMware Inclusive Terminology (ITS) Extension for SonarQube is used to scan source code and other project files for presence of terms which are considered as offensive, and provides recommended alternatives.This extension scans source code for Inclusive Terminology issues during build phase in build pipelines. Issues are reported to Sonar server and will be shown in Project Issues dashboard. After scan, SonarQube provides convenient tools to analyze, fix and report these issues.

in-memory-property-aware-temporal-graph

Temporalgraph aims to provide an in-memory graph database that stores nodes and relationships between nodes in a versioned/time-aware manner.

ui-guided-tours

UI Guided Tours representing step-by-step walkthroughs for VMware products

compliance-dashboard-for-kubernetes

A K8s compliance checker aggregator, with a dashboard and analyzer of K8s resources, as well as 3rd party scanners integration.

efficient-supervised-anomaly-detection

RADE is a resource-efficient decision tree ensemble method (DTEM) based anomaly detection approach that augments standard DTEM classifiers resulting in competitive anomaly detection capabilities and significant savings in resource usage.

api-data-collector

API Data Collector is a Chrome DevTools Extension which captures HTTP Requests and Response data, especially API data. API data can be stored, retrieved, and modified to be functional as a mock server for local application development and production debugging.

telemetry-peak-analyzer

The telemetry peak analyzer handles time series and detect relevant peaks or anomalies in threat telemetry data.

sudo-for-microsoft-windows

Sudo for Windows aims to bring the familiar functionality of the linux Sudo command to Windows environments. It allows for full audit logging of all requests for elevation, along with the ability to tightly control which commands are allowed to be run by which users and groups.

syscall-failure-analyzer

The project is an automatic system-call failure root-cause analyzer for Linux. Today, each error code might be caused by reasons. The tool allows developers and users to trace and analyze syscall call failures to pinpoint the exact reason of the failure.