aboutsummaryrefslogtreecommitdiff
path: root/webmentions_ssg/tasks/source_parser.py (unfollow)
Commit message (Collapse)Author
7 daysrefactor(core)!: standardize application terminologyDennis Fink
Rename configuration keys, task helpers, forms, network utilities, and view endpoints to make their responsibilities and domains more explicit. Align source-management routes and templates with the new terminology and rename the target-matching module and related task abstractions consistently. BREAKING CHANGE: configuration keys have been renamed and sent-source routes move from `/sent` to `/sources`, with corresponding blueprint endpoint changes.
8 daysdocs(core): standardize reST docstringsDennis Fink
Expand function and method documentation with consistent reST parameter, return, and exception fields while clarifying behavior where additional context is useful. Normalize test and migration docstrings to the same documentation conventions.
9 daysrefactor(core): consolidate repeated helper logicDennis Fink
Centralize SQL row counts, hostname parsing, and content-type normalization so tasks, forms, and scanners share consistent implementations. Simplify periodic task registration and admin lookups with table-driven setup and Flask-SQLAlchemy's built-in 404 helper.
9 daysrefactor(sender): flatten canonical URL parsingDennis Fink
Return early when no canonical link is present so canonical URL validation can follow a linear path with less nesting and unchanged scan behavior.
10 dayschore(core): enable stricter Ruff lint rulesDennis Fink
Expand Ruff checks for bugbear, complexity, pathlib, return statements, simplifications, upgrades, and docstring style. Apply the resulting behavior-neutral cleanup across application and test code.
10 daysrefactor(core): split modules by responsibilityDennis Fink
Break up monolithic views, task helpers, networking, CLI, and application extension setup so each module owns a focused concern. Reorganize the test suite around the new boundaries while preserving existing Webmention behavior and coverage.
2026-10-31fix(sender): prevent source scanner path escapesDennis Fink
Reject symlinked source files whose resolved targets leave the configured source directory so scans cannot read unintended files from the host filesystem. Normalize and validate ignored hostname patterns at startup and again at scan time to keep scanner filtering predictable.
2026-10-30fix(sender): validate missing source directoriesDennis Fink
Resolve configured source paths without requiring them to exist first so missing directories produce the scanner's explicit directory validation error instead of leaking a lower-level path resolution exception.
2026-10-30fix(sender): stabilize source content fingerprintsDennis Fink
Hash normalized reader-facing content and outgoing targets instead of raw h-entry markup so generated attributes and relative timestamps do not trigger spurious source revisions or repeat Webmentions. Preserve meaningful changes such as image updates and reaction target changes while ignoring target ordering and other markup noise.
2026-10-30fix(sender): retry manual scans on lock contentionDennis Fink
Ensure requested rescans are not silently dropped when a periodic scan already holds the scanner lock. Defer the manual task and retry it after the active scan finishes while still propagating unrelated scan failures.
2026-10-30feat(sender): add persistent retry backoffDennis Fink
Persist retry state per source revision so temporary delivery failures survive worker restarts and duplicate queued tasks cannot bypass the retry schedule. Use capped exponential backoff, stop after a configurable attempt limit, and reset the retry budget when a source changes or an admin resends manually.
2026-10-30fix(sender): ignore inconclusive empty scansDennis Fink
Treat scans with no successfully processed source pages as inconclusive so a temporary empty or partially rebuilt output directory cannot mark every source deleted or trigger removal Webmentions. Defer pending sends until at least one source is scanned successfully.
2026-10-30fix(sender): prevent duplicate canonical source URLsDennis Fink
Keep persisted sources, including deleted ones, as owners of their canonical URLs so newly scanned aliases cannot claim the same source identity. Skip duplicate canonical paths without blocking unrelated sources from being saved or queued for delivery.
2026-10-30fix(sender): isolate source parser failuresDennis Fink
Prevent malformed pages or unexpected third-party parser exceptions from aborting an entire source scan or causing previously known sources to be treated as deleted. Keep persistence failures visible so database errors still fail the scan.
2026-10-27fix(core): resolve static type checking issuesDennis Fink
2026-10-25refactor(core): simplify configuration keysDennis Fink
Remove the WEBMENTIONS_SSG prefix from application-specific configuration settings and update validators, tasks, and tests to use the shorter names.
2026-08-21test(core): align tests with module ownershipDennis Fink
Move direct validator, model, and Huey extension coverage into dedicated test modules and mock dependencies where behavior belongs to another module. Expand Huey extension typing and coverage while removing duplicate assertions from scanner, sender, form, and view tests.
2026-08-20chore(core): standardize SPDX copyright headersDennis Fink
Add SPDX copyright and license headers to source, test, migration, template, and static files throughout the project. Include the maintainer email in copyright notices and fill in the BSD license copyright holder.
2026-08-19refactor(core): improve typing and test coverageDennis Fink
Restructure database and user CLI commands, make passwords write-only model properties, and use the UTC datetime constant throughout the application. Add PEP 287-style documentation and expand receiver, scanner, sender, and URL security tests to cover error paths and edge cases.
2026-08-17feat(sender): add manual source rescan actionDennis Fink
Add an authenticated action to queue a source rescan from the sent Webmentions overview. Extract the reusable confirmation modal and its JavaScript so received and sent admin actions share the same implementation.
2026-08-15feat(sender): add outgoing Webmention pipelineDennis Fink
Scan generated h-entry documents for Webmention targets and track source revisions and delivery state in the database. Discover target endpoints, send Webmentions asynchronously, and reconcile updated, removed, restored, and deleted sources across scans. Add authenticated views for inspecting sent Webmentions and make the scanner schedule configurable.