- Now we are able to generate an RSS Feed from multiple posts without
needing the website to have an original rss feed that we modify
- The first website that we can do it for is opengoal.dev/blog
- However, some values are temporarily hardcoded for right now, the code
needs to support having RSSItems passed into it so that it can fill in
all of the values based on actual values rather than "example.com"
- 9to5mac is now using a couple of constants for variables now as well.
More refactoring to come for this
- First implementation of the rss feed cache system
- Clean up needs to happen with it. It is in need of extracting code to
functions
- It is functional though and is able to know when to fetch new data or
just serve the existing data it has
- We can now grab previous results from the database to serve back to
the request
- The rss feed items are also now sorted based on their pubDate
- Godot's script is now fully function and scrapes only when needed
- Other scripts still need some work to make it so that they are
utilizing the database
- Duplicate entries in the database aren't checked for just yet, this
needs to be done or else if there are any mistakes in lua, the
databases becomes a mess
- Add sorter file to handle the pubDate sorting
- There is now an "html" object that can be used to perform html parsing
functions. Currently there are select, remove and get functions
- Remove has been added to the html tools so that tags can be removed
from the document
- Godot's blog now can return the blog posts that are listed in the rss
feed!
- Currently it does not cache this data so each request will go and
scrape the data again. This need to be addressed