qortal

Commit Graph

Author	SHA1	Message	Date
CalDescent	b34066f579	More work on HTML parsing. The style tag parsing ideally needs rewriting using an actual CSS parser, but we can get away with this hacky approach in the short term.	3 years ago
CalDescent	b286c15c51	Optimized website serving, and added code to return the correct content types. This is probably the most efficient way to process the data on the fly, but it's still not very scalable. A better approach would be to pre-process the HTML when building the file structure, and then serve them completely statically (i.e. using a standard webserver rather than via application memory). But it makes sense to keep it this way for development and maybe early beta testing.	3 years ago
Marco Moesman	aff4f6c859	Create TransactionValidity_nl.properties	3 years ago
Marco Moesman	1f8f73fa30	Create ApiError_nl.properties	3 years ago
Marco Moesman	620d6624a9	Create SysTray_nl.properties	3 years ago
JaymenChou	287f42ae64	Update and rename SysTray_zh.properties to SysTray_zh_SC.properties Rename to zh_SC for better distinguish between zh_SC (Simple Chinese)and zh_TC(Traditional Chinese) Rephrase some of the words for better understanding.	3 years ago
JaymenChou	d976c97d13	Create SysTray_zh_TC.properties	3 years ago
CalDescent	6d549b0754	Updated AdvancedInstaller project for v1.5.5	3 years ago
CalDescent	02dd64558f	Bump version to 1.5.5	3 years ago
CalDescent	ea5e2f5580	Added POST /site/preview API This can be used to preview a site before signing a transaction and announcing it to the network. The response will need reworking to return JSON (along with most of the other new APIs)	3 years ago
CalDescent	b65c7a75fe	Handle relative links when parsing HTML.	3 years ago
CalDescent	39f5dce51c	Moved "directory" data uploads to new POST /site/upload API. Directory uploads don't make much sense outside of website hosting, so it's best to make this API specific to that purpose.	3 years ago
CalDescent	f77ec1faf6	A very crude proof of concept which serves a website from a zipped (and in future, chunked) data blob. This forms the beginnings of the "website hosting" layer on top of the data storage. It needs a significant rework - most importantly so that we aren't serving every asset from memory, and also so that the correct content-type headers are returned, etc.	3 years ago
CalDescent	cd3a1e0159	Increased max file size to 1GiB. Will review this again later.	3 years ago
CalDescent	3f20fadb81	When zipping files, rename the outer folder to "data" instead of using the original folder name. This means that the data can be accessed deterministically without the need to first lookup the folder name.	3 years ago
CalDescent	1c6428dd3b	Added equivalent split and join test but this time using a 5.5MiB source file.	3 years ago
CalDescent	aca620241a	More work on data file split/join, and added a test.	3 years ago
CalDescent	808b36e088	Specify chunk size when splitting.	3 years ago
CalDescent	1613375cc0	Added more validation of files received in GET /data/file/frompeer	3 years ago
CalDescent	787ef957d2	Added support for uploading an entire directory via POST /data/upload/path If a directory is specified instead of a file, the directory is automatically zipped before being split into chunks.	3 years ago
CalDescent	b915d0aed5	Only create the output file directories when we are actually writing a file there. This should prevent empty directories being created when initializing a nonexistent DataFile using a hash.	3 years ago
CalDescent	16dc5b5327	Include the data length in DataFileMessage, which is more similar to the approach used by ArbitraryDataMessage. These two message types are very similar, except arbitrary code currently has a requirement of one piece of data per signature, whereas DataFile code is independent and can support multiple files per transaction. Maybe the two can be combined at some point, but for now I'll keep them separate.	3 years ago
CalDescent	d25e98d9c4	Include peer connection ID in recently created log message.	3 years ago
CalDescent	227cdc1ec8	Log each sync attempt when our blockchain isn't up to date Without this it can appear as though nothing is happening for a while after the app launches.	3 years ago
CalDescent	c2d0c63db0	Improved error logging.	3 years ago
CalDescent	f5c9807a48	Use contains() rather than equals() when matching a peer in /data/file/frompeer, so that the port can be optionally left out.	3 years ago
CalDescent	7e9b1d5e16	Rework of DataFile.base58Digest() This fixes an NPE when trying to send a file that doesn't exist. It also removes the caching, which we can add again later if it turns out to be needed.	3 years ago
CalDescent	5070c4eea9	Better handling of data file responses in the /data/file/frompeer API endpoint.	3 years ago
CalDescent	33d9c51b6f	Validate supplied base58 string in /data/file/frompeer API endpoint	3 years ago
CalDescent	d0f9d478c2	Fixed bug which prevented the DATA_FILE message ID from making it through to the reply queue.	3 years ago
CalDescent	f296ec46c8	Removed unused headers.	3 years ago
CalDescent	64d19e480b	Chunk size set to 1MB for now, as it seems that our networking code has problems when transferring 2MB chunks. We can increase this later once that problem has been fixed.	3 years ago
CalDescent	2c585a9328	Upper connection time limit reduced from 60 mins to 20 mins. Now that we aren't disconnecting mid sync, we can get away with more frequent disconnections. This brings the average connection length to around 9 mins.	3 years ago
CalDescent	45b0d9e19b	Added more initial peers, submitted by CWDSYSTEMS	3 years ago
CalDescent	026a4b896c	Added BTC and LTC electrum nodes submitted by CWDSYSTEMS	3 years ago
CalDescent	78237fcd11	Don't intentionally disconnect peers if we are currently syncing with them.	3 years ago
CalDescent	73cc3dcb92	Force a disconnect of each peer when the connection age reaches the maximum allowed time. Connection limits are defined in settings (denominated in seconds): "minPeerConnectionTime": 120, "maxPeerConnectionTime": 3600 Peers will disconnect after a randomly chosen amount of time between the min and the max. The default range is 2 minutes to 1 hour, as above. This encourages nodes to connect to a wider range of peers across the course of each day, rather than staying connected to an "island" of peers for an extended period of time. Hopefully this will reduce the amount of parallel chains that can form due to permanently connected clusters of peers. We may find that we need to reduce the defaults to get optimal results, however it is best to do this incrementally, with the option for reducing further via each node's settings. Being too aggressive here could cause some of the earlier problems (e.g. 20% missing blocks minted) to reappear. We can re-evaluate this in the next version. Note that if defaults are reduced significantly, we may need to add code to prevent this from happening mid-sync. With higher defaults, this is less of an issue. Thanks to @szisti for supplying some base code for this commit, and also to @CWDSYSTEMS for diagnosing the original problem.	3 years ago
CalDescent	4cff03e7fe	Include "size" value in the "Synchronized with peer" logs. This indicates the size of the re-org/rollback that was required in order to perform this sync operation. It is only included if it's greater than 0 blocks.	3 years ago
CalDescent	8e35f131d5	Removed debugging log that wasn't intended to be committed.	3 years ago
CalDescent	aafb9d7e4f	Include running total in "Sent X bytes" log entry.	3 years ago
CalDescent	652f30bdbd	Added DATA_FILE and GET_DATA_FILE message types.	3 years ago
CalDescent	f4ba7b2a0c	Added onNetworkGetDataFileMessage() handler	3 years ago
CalDescent	592490d709	Added GET /data/file/frompeer API endpoint This requests a file from the supplied peer address, and stores a copy locally if successful. Still a work in progress.	3 years ago
CalDescent	5ac676d201	Added DataFileMessage and GetDataFileMessage, used for requesting and sending files between peers.	3 years ago
CalDescent	abfe0a925a	More DataFile methods and improvements	3 years ago
CalDescent	fa11f4f45b	Moved DataFileChunk(byte[] fileContent) constructor to the superclass so it can be used by regular data files too.	3 years ago
CalDescent	1e8dbfe4b7	Delete chunk if it fails the hash validation in the constructor.	3 years ago
CalDescent	f82f2bd287	Added DELETE /data/file API endpoint This deletes a file referenced by a user supplied SHA256 digest string (which we will use as the file's "ID" in the Qortal data system). In the future this could be extended to delete all associated chunks, but first we need to build out the data chain so we have a way to look up chunks associated with a file hash.	3 years ago
CalDescent	76742c3869	Removed .dat extension, and use an extra level in the directory structure (data/aB/cD/aBcDeF... etc)	3 years ago
CalDescent	9407e7e418	Data storage location moved to settings ("dataPath")	3 years ago

... 2 3 4 5 6 ...

1421 Commits (8a8ec32f2cbcd1c921cf008a4db4ac48c5b4ae12) All Branches Search

1421 Commits (8a8ec32f2cbcd1c921cf008a4db4ac48c5b4ae12)

All Branches