Hosted MCP server · #132 most used on Smithery

srv-d7aoqmh5pdvs7391dcqg

ciprianpater/srv-d7aoqmh5pdvs7391dcqg

# NWO Robotics MCP Server Control real robots, IoT devices, and autonomous agent swarms through natural language — powered by the NWO Robotics API. --- ## What This Server Does This MCP server exposes the full NWO Robotics API as 64 ready-to-use tools. Any MCP-compatible AI agent (Claude, ChatGPT, Cursor, etc.) can use it to: - Send natural language instructions to physical robots - Run Visual-Language-Action (VLA) inference on live camera feeds - Plan, validate, and execute multi-step robot tasks - Monitor sensors, detect slip, and fuse multi-modal data - Train robots online with reinforcement learning - Register and manage agent identities on Base mainnet via the Cardiac biometric ID system No local installation needed. The server runs on Render and is ready to connect. --- ## Tools Overview ### 🤖 VLA Inference & Models Run Vision-Language-Action inference on any supported robot. Send a text instruction and camera images, receive joint action vectors in real time. Supports auto model routing, ultra-low-latency Cloudflare edge inference (28ms avg), and WebSocket streaming at up to 50Hz. `vla_inference` · `edge_inference` · `list_models` · `get_model_info` · `get_streaming_config` --- ### 🦾 Robot Control & State Query live robot state (joint angles, gripper, battery, position), execute pre-computed action sequences, and fuse camera + lidar + thermal + force + GPS sensor inputs into a single inference call. `query_robot_state` · `execute_actions` · `sensor_fusion` · `robot_query` · `get_agent_status` --- ### 🗺️ Task Planning & Learning Decompose complex instructions into ordered subtasks, execute them step by step, poll progress, and log outcomes so the model learns and improves with every run. `task_planner` · `execute_subtask` · `status_poll` · `learning_recommend` · `learning_log` --- ### 🔑 Agent Management Self-register a new AI agent in under 2 seconds, check your monthly API quota, upgrade tiers by paying ETH, and manage robot registrations and capabilities. | Tier | Calls/month | Cost | |------|-------------|------| | Free | 100,000 | $0 | | Prototype | 500,000 | ~0.015 ETH/mo | | Production | Unlimited | ~0.062 ETH/mo | `register_agent` · `check_balance` · `pay_upgrade` · `create_wallet` · `register_robot` · `update_agent` · `get_agent_info` --- ### 🔍 Agent Discovery Discover all available execution modes (mock / simulated / live), robot types, VLA models, and sensor capabilities. Validate tasks with a dry-run before committing to execution. `nwo_health` · `nwo_whoami` · `discover_capabilities` · `dry_run` · `plan_task` --- ### 🔌 ROS2 Bridge (Physical Robots) Connect directly to physical robots over the ROS2 bridge. Send joint commands, submit action sequences, and trigger emergency stops on one or all robots within 10ms. Supported: UR5e, Panda, Spot, Unitree G1, and more. `ros2_list_robots` · `ros2_robot_status` · `ros2_send_command` · `ros2_submit_action` · `ros2_emergency_stop` · `ros2_emergency_stop_all` · `ros2_get_robot_types` --- ### 🧪 Physics Simulation Simulate trajectories, check for collisions, estimate joint torques, validate grasps, and plan collision-free motions with MoveIt2 — before touching real hardware. `simulate_trajectory` · `check_collision` · `estimate_torques` · `validate_grasp` · `plan_motion` · `get_scene_library` · `generate_scene` --- ### 📐 Embodiment & Calibration Browse the robot embodiment registry (DOF, joint limits, sensors), download URDF models, get normalization parameters for VLA inference, and run automatic joint calibration. `list_embodiments` · `get_robot_specs` · `get_normalization` · `download_urdf` · `get_test_results` · `compare_robots` · `run_calibration` · `calibrate_confidence` --- ### 🧠 Online RL & Fine-Tuning Start online reinforcement learning sessions, stream state/action/reward telemetry, build fine-tuning datasets from logged runs, and launch LoRA fine-tuning jobs on any base VLA model. `start_rl_training` · `submit_rl_telemetry` · `create_finetune_dataset` · `start_finetune_job` --- ### 🖐️ Tactile Sensing (ORCA Hand) Read 256-taxel tactile sensor arrays from the ORCA robot hand, assess grip quality and object texture, and detect slip in real time to prevent dropped objects. `read_tactile` · `process_tactile` · `detect_slip` --- ### 📦 Dataset Hub Access 1.54 million+ human robot demonstrations for the Unitree G1 humanoid (430+ hours, LeRobot-compatible format) for training and fine-tuning. `list_datasets` --- ### 🫀 Cardiac Blockchain Identity (Base Mainnet) Register AI agents on Base mainnet and receive a permanent soul-bound Digital ID (`rootTokenId`). Issue verifiable credentials for task authorization, swarm control, location access, and payments — all gasless via the NWO relayer. Smart contracts deployed on Base Mainnet (Chain ID 8453): - `NWOIdentityRegistry` — `0x78455AFd5E5088F8B5fecA0523291A75De1dAfF8` - `NWOAccessController` — `0x29d177bedaef29304eacdc63b2d0285c459a0f50` - `NWOPaymentProcessor` — `0x4afa4618bb992a073dbcfbddd6d1aebc3d5abd7c` `cardiac_register_agent` · `cardiac_identify_agent` · `cardiac_renew_key` · `cardiac_issue_credential` · `cardiac_check_credential` · `cardiac_grant_access` · `cardiac_get_nonce` · `cardiac_check_access` · `cardiac_payment_process` --- ### 🔮 Cardiac Oracle Validate ECG biometric data from smartwatches to authenticate human identities, compute cardiac hashes, and verify recent validations. `oracle_health` · `oracle_validate_ecg` · `oracle_hash_ecg` · `oracle_verify` --- ## Supported Robot Models | Model | Type | Capabilities | |-------|------|--------------| | `xiaomi-robotics-0` | VLA | Grasp, navigate, manipulate | | `pi05` | VLA | General manipulation | | `groot_n1.7` | VLA | Humanoid control | | `deepseek-ocr-2b` | OCR | Label reading, text recognition | --- ## Example Usage **Pick and place:** > "Pick up the red box from the table and place it on shelf B" **Sensor query:** > "What is the temperature in warehouse zone 3?" **Safety:** > "Run a safety check before moving robot_001 to the loading dock" **Swarm:** > "Deploy all available robots to patrol the perimeter" **Learning:** > "What grip technique should I use for fragile glass objects?" --- ## Links - 🌐 NWO Capital - 📄 Agent Skill File - 📖 API Docs - 🧬 Cardiac SDK - 🔑 Get API Key - 🤗 Live Demo - 📜 OpenAPI Spec --- ## Support 📧 support@nwo.capital

Uses
4.1k
Tools
70
Runs
Hosted
Listed
7mo ago

Get started

Add it to your agent

npx -y @smithery/cli@latest install ciprianpater/srv-d7aoqmh5pdvs7391dcqg --client claude

Swap --client claude for cursor, vscode, windsurf or another client. The CLI asks for any required settings.

What it can do

70 tools

vla_inference5 paramsRun VLA inference: send instruction + base64 images, receive joint actions
ParameterTypeDescription
imagesarrayBase64-encoded camera images
agent_idstringTarget robot/agent ID
model_idstringe.g. xiaomi-robotics-0, pi05, groot_n1.7
instructionstringNatural language robot instruction
use_model_routerbooleanAuto-select best model for task type
edge_inference2 paramsUltra-low-latency VLA inference via Cloudflare global edge (28ms avg)
ParameterTypeDescription
imagesarray
instructionstring
list_modelsList all available VLA models with capabilities, status, and latency
get_model_info1 paramGet detailed info and benchmark performance for a specific model
ParameterTypeDescription
model_idstringe.g. xiaomi-robotics-0
get_streaming_configGet available WebSocket streaming frequencies and chunk size ranges
query_robot_state2 paramsQuery robot state: joint angles, gripper state, position (x,y,z), battery
ParameterTypeDescription
agent_idstringRobot or agent ID
include_imagebooleanInclude camera image in response
execute_actions4 paramsExecute a sequence of pre-computed joint action vectors on a robot
ParameterTypeDescription
speednumber
actionsarray2D array: each row is one joint-space action
agent_idstring
safety_checkboolean
sensor_fusion4 paramsRun VLA inference fusing camera + lidar + thermal + force + GPS sensor data
ParameterTypeDescription
imagesarray
sensorsobject
agent_idstring
instructionstring
robot_query1 paramQuick query: robot active/idle, battery percent, current task
ParameterTypeDescription
agent_idstring
get_agent_status1 paramGet tasks completed and success rate for a robot agent
ParameterTypeDescription
agent_idstring
task_planner3 paramsDecompose a complex instruction into ordered subtasks with time estimates
ParameterTypeDescription
contextobjectEnvironment context e.g. {location, known_objects}
agent_idstring
instructionstring
execute_subtask3 paramsExecute a numbered subtask from a multi-step plan
ParameterTypeDescription
plan_idstring
agent_idstring
subtask_orderinteger1-based subtask index
status_poll2 paramsPoll the progress and status of a running task (completed, progress%, errors)
ParameterTypeDescription
task_idstring
agent_idstring
learning_recommend2 paramsGet technique recommendations for a task (grip_force, approach_speed, etc.)
ParameterTypeDescription
agent_idstring
task_descriptionstring
learning_log7 paramsLog a completed task execution so the model can learn from it
ParameterTypeDescription
successboolean
task_idstring
agent_idstring
sensor_dataobject
technique_usedstring
task_descriptionstring
execution_time_msnumber
register_agent4 paramsSelf-register a new AI agent — returns api_key, agent_id, and 100k free monthly quota
ParameterTypeDescription
agent_namestring
agent_typestring
capabilitiesarray
wallet_addressstringEthereum wallet (or "auto" to generate)
check_balanceCheck quota: used this month, remaining, limit, tier, subscription expiry
pay_upgrade3 paramsUpgrade tier by paying ETH (prototype=500k/mo ~0.015ETH, production=unlimited ~0.062ETH)
ParameterTypeDescription
tierstring
tx_hashstringETH transaction hash of payment
billing_periodstring
create_walletCreate a hosted MoonPay wallet so the agent can be funded via credit card
register_robot4 paramsRegister a new robot entity in the NWO system
ParameterTypeDescription
namestring
typestringmobile_arm | manipulator | mobile | humanoid
agent_idstring
capabilitiesarray
update_agent3 paramsUpdate a robot agent's capabilities or operational status
ParameterTypeDescription
statusstring
agent_idstring
capabilitiesarray
get_agent_info1 paramGet full agent profile: name, type, status, total tasks, success rate
ParameterTypeDescription
agent_idstring
nwo_healthCheck NWO API online status and timestamp
nwo_whoamiGet the agent_id, tier, and quota_remaining for the current API key
discover_capabilitiesDiscover execution modes, robot/task types, available models, sensors, and features
dry_run3 paramsValidate task feasibility without executing — safety check, confidence, duration estimate
ParameterTypeDescription
robot_idstring
instructionstring
execution_modestring
plan_task3 paramsGenerate a phased plan: preparation → perception → execution → verification
ParameterTypeDescription
robot_idstring
instructionstring
execution_modestring
ros2_list_robotsList all robots currently connected to the ROS2 bridge
ros2_robot_status1 paramGet live status of a specific physical robot via ROS2 bridge
ParameterTypeDescription
robot_idstring
ros2_send_command3 paramsSend a named command + joint angles to a physical robot via ROS2 bridge
ParameterTypeDescription
commandstringe.g. move_arm, home, open_gripper, close_gripper
robot_idstring
joint_anglesarray
ros2_submit_action2 paramsSubmit a computed action sequence directly to a robot via ROS2 bridge
ParameterTypeDescription
actionsarray2D action array from VLA inference
robot_idstring
ros2_emergency_stop2 paramsEmergency stop a single robot via ROS2 bridge (10ms response)
ParameterTypeDescription
reasonstring
robot_idstring
ros2_emergency_stop_all1 paramEmergency stop ALL connected robots via ROS2 bridge
ParameterTypeDescription
reasonstring
ros2_get_robot_typesGet all robot types supported by the ROS2 bridge with DOF, speed, and specs
simulate_trajectory4 paramsSimulate a trajectory with physics: check feasibility, collisions, time estimate
ParameterTypeDescription
agent_idstring
trajectoryarray
physics_paramsobject
check_collisionboolean
check_collision3 paramsCheck a trajectory for collisions with environment obstacles
ParameterTypeDescription
agent_idstring
trajectoryarray
environmentobject
estimate_torques3 paramsEstimate joint torques for a trajectory given payload mass
ParameterTypeDescription
agent_idstring
trajectoryarray
payload_massnumberPayload mass in kg
validate_grasp4 paramsValidate whether a grasp will be stable for object shape, mass, and grip force
ParameterTypeDescription
agent_idstring
grip_forcenumberGrip force in Newtons
object_massnumberMass in kg
object_shapestringcylinder | box | sphere | irregular
plan_motion5 paramsPlan a collision-free motion path using MoveIt2
ParameterTypeDescription
plannerstring
agent_idstring
goal_posearrayGoal joint angles or Cartesian pose
start_posearrayStart joint angles
avoid_collisionsboolean
get_scene_libraryGet available simulation scenes (warehouse, kitchen, outdoor, etc.)
generate_scene4 paramsGenerate synthetic robot training scenes using NVIDIA Cosmos 3
ParameterTypeDescription
promptstringScene description, e.g. "Warehouse with pallets and boxes"
objectsarray
lightingstring
variationsinteger
list_embodiments1 paramList all supported robot embodiments filterable by type
ParameterTypeDescription
filter_typestringmanipulator | mobile | humanoid | mobile_arm
get_robot_specs1 paramGet full specifications for a robot type: DOF, joint limits, sensors, max speed
ParameterTypeDescription
robot_typestringe.g. ur5e, panda, spot, g1
get_normalization1 paramGet joint normalization parameters (min, max, mean, std) needed for VLA inference
ParameterTypeDescription
robot_typestring
download_urdf1 paramGet URDF robot model XML for a given robot type
ParameterTypeDescription
robot_typestring
get_test_results1 paramGet LIBERO, CALVIN, and SimplerEnv benchmark results for a robot type
ParameterTypeDescription
robot_typestring
compare_robots2 paramsCompare multiple robot types on DOF, speed, accuracy, and other fields
ParameterTypeDescription
robot_typesarraye.g. ["ur5e", "panda", "spot"]
compare_fieldsarray
run_calibration4 paramsRun automatic calibration on a robot (joint offset, force-torque, camera extrinsic)
ParameterTypeDescription
methodstring
samplesinteger
agent_idstring
calibration_typestring
calibrate_confidence2 paramsCalibrate raw model confidence score to a calibrated success probability with CI
ParameterTypeDescription
model_idstring
model_confidencenumber
start_rl_training3 paramsStart an online RL training session with custom reward configuration
ParameterTypeDescription
agent_idstring
task_namestring
reward_configobject
submit_rl_telemetry5 paramsSubmit state/action/reward data to an active RL session for online policy update
ParameterTypeDescription
statearray
actionarray
rewardnumber
telemetryobject
rl_session_idstring
create_finetune_dataset4 paramsCreate a fine-tuning dataset from logged task executions over a date range
ParameterTypeDescription
formatstring
agent_idstring
end_datestringYYYY-MM-DD
start_datestringYYYY-MM-DD
start_finetune_job4 paramsStart a LoRA fine-tuning job on a base VLA model using a prepared dataset
ParameterTypeDescription
rankinteger
algorithmstring
base_modelstring
dataset_idstring
read_tactile2 paramsRead ORCA robot hand tactile sensor data (256 taxels per finger, force, slip)
ParameterTypeDescription
fingerstring
sensor_typestring
process_tactile2 paramsProcess tactile data to assess grip quality, object texture, recommended grip force
ParameterTypeDescription
agent_idstring
tactile_dataobject
detect_slip3 paramsDetect object slip by comparing current vs previous tactile readings
ParameterTypeDescription
agent_idstring
current_tactilearray
previous_tactilearray
list_datasetsList Unitree G1 robot demonstration datasets — 1.54M+ episodes, 430+ hours, LeRobot format
cardiac_register_agent2 paramsRegister AI agent on Base mainnet. Returns permanent soul-bound rootTokenId.
ParameterTypeDescription
api_key_hashstringkeccak256(api_key) as 0x hex string
moonpay_walletstringAgent Ethereum wallet address
cardiac_identify_agent1 paramLook up an agent rootTokenId on-chain by their hashed API key
ParameterTypeDescription
api_key_hashstringkeccak256(api_key) as 0x hex string
cardiac_renew_key4 paramsRenew agent API key binding on Base mainnet (requires EIP-712 agent signature)
ParameterTypeDescription
deadlineintegerUnix timestamp deadline for signature
agent_sigstringEIP-712 agent signature 0x...
root_token_idstring
new_api_key_hashstring
cardiac_issue_credential4 paramsIssue a verifiable credential to an identity (task_auth, capability, swarm_cmd, emergency)
ParameterTypeDescription
expires_atintegerUnix timestamp for expiry
root_token_idstring
credential_hashstring
credential_typestringkeccak256 of credential name e.g. keccak256("task_auth")
cardiac_check_credential2 paramsCheck if a rootTokenId currently holds a valid credential of the given type
ParameterTypeDescription
root_token_idstring
credential_typestring
cardiac_grant_access3 paramsGrant location access credential to an identity for a time window
ParameterTypeDescription
location_hashstring
root_token_idstring
duration_secondsinteger
cardiac_get_nonce1 paramGet EIP-712 signing nonce for a wallet (required before relay message signing)
ParameterTypeDescription
walletstring
cardiac_check_access2 paramsCheck location access for a rootTokenId. Returns granted + deny reason code.
ParameterTypeDescription
location_idstring
root_token_idstring
cardiac_payment_process4 paramsProcess a payment via Cardiac NWOPaymentProcessor smart contract (0x4afa...)
ParameterTypeDescription
terminal_idstring
amount_centsinteger
currency_codestring
root_token_idstring
oracle_healthCheck Cardiac oracle: health, chain, relayer balance, ECG config
oracle_validate_ecg2 paramsValidate ECG biometric data to prove human identity (10/min rate limit)
ParameterTypeDescription
walletstring
ecg_dataobject
oracle_hash_ecg2 paramsCompute a cardiac hash from ECG RR intervals without full validation
ParameterTypeDescription
walletstring
rr_intervalsarrayRR intervals in ms
oracle_verify2 paramsVerify a recent ECG validation is cached by cardiac hash (in-memory, resets on restart)
ParameterTypeDescription
walletstring
cardiac_hashstring