frappe-testing — independently scanned and version-tracked by SaferSkills.
SaferSkills independently audited frappe-testing (Agent Skill) and scored it 100/100 (green). The audit ran 55 deterministic rules across Security, Supply Chain, Maintenance, Transparency, and Community; it found 0 high-severity and 0 lower-severity findings. The full rule-by-rule trace and per-finding evidence are below. Free, methodology-open.
Findings & checks · 0 flagged
Every scanned point with the score it earned and what moved between them.
First recorded scan — no prior version to compare against.
The primary manifest — the file an agent reads to learn what this artifact does.
Write and run tests for Frappe applications using the built-in testing framework.
# Install dev dependencies
bench setup requirements --dev
# Ensure site is ready
bench --site <site> migrate# Run all tests for an app
bench --site <site> run-tests --app my_app
# Run tests for specific module
bench --site <site> run-tests --module my_app.my_module.tests
# Run tests for specific DocType
bench --site <site> run-tests --doctype "My DocType"
# Verbose output
bench --site <site> run-tests --app my_app -v
# Run single test file
bench --site <site> run-tests --module my_app.doctype.sample_doc.test_sample_docCreate test_<doctype_name>.py alongside the DocType:
# my_app/doctype/sample_doc/test_sample_doc.py
import frappe
from frappe.tests.utils import FrappeTestCase
class TestSampleDoc(FrappeTestCase):
def setUp(self):
# Create test data
self.doc = frappe.get_doc({
"doctype": "Sample Doc",
"title": "Test Document"
}).insert()
def tearDown(self):
# Cleanup
frappe.delete_doc("Sample Doc", self.doc.name, force=True)
def test_creation(self):
self.assertEqual(self.doc.title, "Test Document")
def test_validation(self):
doc = frappe.get_doc({
"doctype": "Sample Doc",
"title": "" # Invalid - required field
})
self.assertRaises(frappe.ValidationError, doc.insert)
def test_workflow(self):
self.doc.status = "Approved"
self.doc.save()
self.assertEqual(self.doc.status, "Approved")# my_app/tests/test_api.py
import frappe
from frappe.tests.utils import FrappeTestCase
class TestAPI(FrappeTestCase):
def test_whitelist_method(self):
from my_app.api import process_order
# Create test order
order = frappe.get_doc({
"doctype": "Sales Order",
"customer": "_Test Customer"
}).insert()
# Test the API
result = process_order(order.name, "approve")
self.assertEqual(result["status"], "success")
# Cleanup
frappe.delete_doc("Sales Order", order.name, force=True)
def test_permission_denied(self):
# Test as restricted user
frappe.set_user("[email protected]")
from my_app.api import sensitive_action
self.assertRaises(frappe.PermissionError, sensitive_action, "doc-001")
# Reset user
frappe.set_user("Administrator")def test_role_permissions(self):
# Create user with specific role
user = frappe.get_doc({
"doctype": "User",
"email": "[email protected]",
"roles": [{"role": "Sales User"}]
}).insert()
frappe.set_user("[email protected]")
# Test permission
self.assertTrue(frappe.has_permission("Sales Order", "read"))
self.assertFalse(frappe.has_permission("Sales Order", "delete"))
# Cleanup
frappe.set_user("Administrator")
frappe.delete_doc("User", user.name, force=True)# my_app/doctype/sample_doc/test_records.json
[
{
"doctype": "Sample Doc",
"title": "Test Record 1"
},
{
"doctype": "Sample Doc",
"title": "Test Record 2"
}
]Reference in tests:
class TestSampleDoc(FrappeTestCase):
def test_fixture_loaded(self):
doc = frappe.get_doc("Sample Doc", "Test Record 1")
self.assertIsNotNone(doc)# Run UI tests for an app
bench --site <site> run-ui-tests my_app
# Headless mode
bench --site <site> run-ui-tests my_app --headlessbench --site <site> run-tests --app my_apptest_ and class/method names follow conventionsfrappe.set_user("Administrator") in setuptearDown() or use frappe.db.rollback()frappe.set_user() to test as specific users| Mistake | Why It Fails | Fix |
|---|---|---|
Not using FrappeTestCase | Missing test setup/teardown | Extend frappe.tests.utils.FrappeTestCase |
| Missing db rollback | Test pollution, flaky tests | Use frappe.db.rollback() in tearDown or transactions |
| Flaky async tests | Intermittent failures | Use frappe.tests.utils.run_until() or proper async handling |
| Testing implementation not behavior | Brittle tests | Test outcomes, not internal method calls |
| Hardcoded test data | Conflicts with existing data | Use unique names like _Test Record {uuid} |
| Skipping permission tests | Security holes | Test with different user roles, not just Administrator |
~30 seconds. Free. No account. Every finding cites a rule and a line of evidence.