Hugo tutorial #1435
Open
Hugo tutorial #1435
+687
−1
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Summary commit of all changes * Changed to Tilburg Sciencehub credentials * Removed code lines in README.md * snake_case implementation * extract_all_http_links function made async * uncommented workflow_dispatch for testing purposes * Made the script fully async * Bugfix: wrong variabel name * Debugging broken_link_checker.py * Made identify_broken_links function async * Changed username for testing purposes * Made push_issue_git_batched async * Bugfix: forgot await in call * More strict external link check * More strict external link check * More refined filtering of broken links * Changed name of function and variable * Sleep between batches of requests, lower concurrency * Semaphore in check_all_urls * Fixed status code 999 * Fixed status code 999 * Small fixes * Removed pandas from code * Further code refinement * Concurrency and retry logic implemented * Added remarks to clarify code * Removed duplicate code lines * Set concurrency in first pass to 4 * Use of list of rules * Small fixes * Test run with 10 pages * Test run with 10 pages * Distinction between internal links and external links implemented * Changed user to own account for testing purposes * Modulair approach with classes * Distinction between internal and external links in issue * Filter out status code None * Delay added per domain (for external links) * Bug fix + smart throttling * Convert https to http and check * Moved conversion of https to http to extract_links and check * Error fetching status=0 fix * Error fetching status=0 fix * Split by domain * Further sharpening * Further sharpening: skip external 403s * Bug fix: skip external 403s * Bug fix: skip external 403s * Check all links * Bugfix class of reporter * Bugfix class of reporter * Bugfix class of reporter * Bugfix class of reporter * Bugfix class of reporter * Bugfix class of reporter * Scrape 20 pages * Scrape 20 pages * Sitemap class * Sitemap class bug fixes * Sitemap class bug fixes * Conversion to constants * Class Reporter revision * GITHUB repo constant * LinkErrorChecker class * LinkErrorChecker class bugfixes * LinkErrorChecker class bugfixes * LinkErrorChecker class bugfixes * LinkErrorChecker improvements * LinkErrorChecker improvements * Error loging in main_async_scraper * Debugging: match_broken_links * Linkextracter class added * Linkextracter bugfixes * Linkextracter bugfixes * Linkextracter bugfixes * LinkErrorChecker bugfixes * LinkErrorChecker bugfixes * LinkExtractor bugfixes * General bugfixes * General bugfixes * General bugfixes * Scrape all pages * Reverted code to non-modular version, removed doublures * TSH credentials * Added inline comments and docstrings to code * Converted inline comments from what to why * Test round * Tilburg Sciencehub domain check * Tilburg Sciencehub github issues credentials * Removed print statement and obsolete file * Modified Generate JWT step * Indentation change * Indentation change * Changed Generate JWT step * Changed Generate JWT step * Testrun with add-mask * Testrun with add-mask: debugging * tilburg sciencehub credentials
…to hugo_tutorial
…to hugo_tutorial
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request includes a new tutorial on building and hosting a static site with Hugo. Within the Digital Research Support (DRS) team, there was a need for a more accessible tutorial that we can refer our researchers to, tailored to their needs. If you decide to adopt this tutorial, I’ll leave it up to you whether you want it to exist alongside the existing Hugo tutorial. I would be glad to receive your feedback. Please don’t hesitate to ask questions or share comments.