| Age | Commit message (Collapse) | Author |
|---|
|
real-time processing (#16603)
* several changes to emphasize setup and use of auto-archiving rather than real-time processing
* apply some pr feedback
* Applying more pr feedback.
* apply review fixes
* ignore ability to archive segments in real time
* another tweak
* update tests
* fix another test
* fix ui tests
* update test
* fix evolution icon bug
* Update TreemapVisualization and update expected screenshots
* update screenshots
|
|
(#16595)
* Add new INI config [General] enable_framed_allow_write_admin_token_auth to allow framed matomo use case to still function in Matomo 4.
* Link to faq in exception message.
* apply pr feedback and write integration tests (not passing)
* fix test
* fix test
* update screenshot
* fix more ui tests
* update exception message
* update some expected screenshots
* update screenshot
Co-authored-by: Thomas Steur <tsteur@users.noreply.github.com>
|
|
|
|
files (#16480)
|
|
|
|
|
|
(#15889)
* Adding initial new code for cron archive rewrite.
* first pass at removing unused CronArchive code.
* unfinished commit
* fill out archiveinvalidator code
* getting some tests to pass
* unfinished commit
* fixing part of test
* Another test fix.
* another sql change
* fix broken merge or something else that went wrong
* Couple more fixes and extra logs.
* Fixing enough issues to get core archive command to run completely.
* Fix and log change.
* Fixed more segment/test related issues for CronArchiveTest. Includes optimization for no visits for period + segment process from handling.
* another optimization and possible build fix
* no visit optimization
* test fix
* Implement archiving_custom_ranges logic w/ queue based implementation
* fixes to get archivecrontest to work
* add logic to invalidate today period
* fix optimization and some tests
* Fixing more tests.
* Fixing more tests
* debug travis failure
* more test fixes
* more test fixes, removing more unneeded code, handling some TODOs
* Handle more TODOs including creating ArchiveFilter class for some cli options.
* tests and todos
* idarchives are specific to table + start on archivefilter tests
* one test
* more TODOs and tests
* more tests and todo taken care of
* handle more todos
* fixing more tests
* fix comment
* make sure autoarchiving is enabled for segments when cron archive picks them up
* Fixing test.
* apply more pr feedback
* order by date1 asc
* quick refactor
* use batch insert instead of createDummyArchives
* apply rest of pr feedback
* add removed events, add new test, fix an issue (when deleting idarchives older than do not lump all segments together).
* re-add fixed/shared siteids
* fix tests
* incomplete commit
* Insert archive entries into archive_invalidations table.
* Use invalidations table in core:archive and get ArchiveCronTest to pass.
* fixing some tests
* debugging travis
* fix more tests & remove DONE_IN_PROGRESS which is no longer used.
* fix more tests
* Allow forcing plugin specific archive in core:archive.
* When querying from archive data use all available archives including "all" archives and plugin specific archives.
* Adding some code for invalidating specific plugin archives.
* Get archive invalidation test to pass.
* add plugin capability to invalidate command
* Handle plugin only archives in core:archive.
* Add Archive test and get ArchiveCronTest to pass.
* update some expected files
* Fix some more tests.
* incomplete commit
* allow invalidating individual reports
* adding more API for DONE_PARTIAL support
* get archivecrontest to pass
* add archive processor tests
* fix some test randomnes
* when purging keep latest partial archives if there is no newer whole archive
* add rearchivereport method + some unfinished tests
* Add archiveReports API method, fix race condition in test, when archiving single report, always ignore inserting other reports.
* require archivers to handle partial archives themselves entirely instead of trying to do it automatically and allow requested report to be any string
* couple fixes
* Use core config option for last N montsh to invalidate.
* Add test for ArchiveSelector method.
* Ignore archives w/ deactivated plugins.
* Refactor queue looping into new QueueConsumer class.
* apply more review feedback + another fix
* invalidate segments too in reArchiveReport w/ etsts
* remove DONE_IN_PROGRESS, no longer used. use new status in query and add queue consumer test.
* forgot to add file
* delete old unneeded archives when finalizing a new one.
* tweak invalidation archive description
* add plugin archiving tests and get them to pass
* fix test
* many fixes
* fix another test
* update expected test files
* fix more tests
* last test fixes hopefully
* tweak log
* In case a column already exists, do not try to add it in an AddColumns migration or the entire migration will fail and no columns will be added.
* try to fix tests again
* fix again?
* apply some review feedback + fix test
* fix test
* fix another test
* couple fixes
* Remove extra param.
* apply pr feedback
* check for usable archive before invalidating and before initiating archiving
* fixing tests
* fixing tests
* fixing tests
* fix another test issue
* fix archiveinvalidator test
* fix one test and debug another
* more debugging
* fix test
* use twig
* remove no longer needed change
* add back previous logic
* fix tracking is not working
* apply pr feedback and add tests
* fixing tests
* update submodule
* debugging random travis failure
* update test
* more debugging
* more debugging
* another attempt at debugging
* Lets try this fix
* trying to fix the build
* debug
* simpler test
* fix test
* fix test
* fix test
* fix test
* fix test failure
* update screenshots
* update screenshots
Co-authored-by: Thomas Steur <tsteur@users.noreply.github.com>
|
|
|
|
* Rename config setting for maximum rows in custom dimension reports
* automatically set new config values if old ones were set
* submodule update
* update expected UI files
|
|
* Backport userId to overwrite visitorId feature
* fix ui test
|
|
* By default userId should overwrite the visitorId
* handle new visits
* Update Request.php
* fix some tests
* fix tests
* fix more tests
* add more tests, fix tests
* Update global.ini.php
* add better tests
* update screenshot
* update test file
Co-authored-by: diosmosis <diosmosis@users.noreply.github.com>
|
|
|
|
* Removes CustomVariables plugin
* removes CustomVariables plugin from core list
* Move methods to get custom variables from request to the plugin
* define visit fields to persist in plugin
* do not use custom variables plugin if not available
* adjust test requirements for CustomVariables plugin
* Only execute update if plugin is installed
* do not consider custom variables widget as api in tests
* move autosuggest tests for custom variables to plugin
* do not use custom variable segments in core tests
* move multi column segment test to custom variables plugin
* do not use custom variable segment in archive cron test
* update access log to use new product view parameters instead of custom variables
* move some custom variables based tests to plugin
* Use Contents API instead of CustomVariables for CSV export tests
* skip some tests if CustomVariables plugin is not available
* Adjust tracker code generator tests to work without custom variables plugin
* [TEMP] remove custom variables from system test output
* adjust some tests to run without custom variables plugin
* apply some review feedback
* Readds Custom Variables as submodule (#16104)
* Adds CustomVariables as submodule
* Revert "[TEMP] remove custom variables from system test output"
This reverts commit 30b56dc135b6c130c841306f739dbcd7d9f4a366.
* use submodule branch
* test changes due to loading CustomVariables as submodule (plugin order)
* updates some expected screenshots
* improve test fixture
* submodule update
|
|
|
|
|
|
* Allow configuration of a shorter lock wait time in tracker mode
* do not catch errors for single tracking request
* Update global.ini.php
|
|
|
|
* Allow using matomo prefixed parameters for campaigns
* Adds changelog
* also add mtm_ prefixes
* rebuilt piwik.js
* update screenshot
Co-authored-by: sgiehl <sgiehl@users.noreply.github.com>
Co-authored-by: diosmosis <diosmosis@users.noreply.github.com>
|
|
* Removes AWS test runner
* remove no longer needed settings
Co-authored-by: Thomas Steur <tsteur@users.noreply.github.com>
|
|
|
|
* require composer package phpmailer/phpmailer
* change mail class to use phpmailer instead of Zend_Mail
* removes Zend_Mail and Zend_Mime
* submodule
* fix tests
* enable smtp debug for test mail command
* fix embedded images
* set language for phpmailer
* apply some review feedback
* removes Zend_Validate (#15907)
* don't inline file without cid
* submodule update
* fix test
* decouples Mail class from PHPMailer and moves sending mails to new transport layer
* submodule
* cleanup
* unset xmailer header
* simplify mail attachment handling
* adds methods to add bcc recipients
* change implementation of setReplyTo
|
|
* Improve naming of methods for segments to rescrict access for anonymous user
* Introduce new classes SegmentsList nad DimensionSegmentFactory
* removes SegmentEditor\SegmentList and adds some tests
* submodule updates
|
|
* Adds various new performance metrics and dimensions
* Adds tracking for new performance values
* track performance metrics only for page views
* Archive new performance metrics
* move everything into a new plugin
* fix archiving of overall metrics
* Adds new overview reports
* show performance metric on some more reports
* adds new page performance icon
* Adds new row action to view page performance evolution for pages
* Adds new stacked bar visualization for page performance evolutions
* show total value in stacked bar chart tooltips
* [TEMP] use php tracker package branch
* Adds some simple System tests
* Adds some UI tests
* remove performance metrics from action reports that don't support it
* move calculation to api
* mark as tracker plugin
* improve calculation of maximum value in bar evolution chart
* enrich existing tests with performance metrics
* updates expected test files
* send performance metrics with the next request after they are available
this might not be the pageview it self but any request after it, like a ping, goal, ...
* Adds request processor to process performance metrics not sent directly with the page view
* rebuilt js
* Add metric decriptions to evolution chart documentation
* fix convertion of microseconds part
* Ensure average page load time is displayed in evolution graph in scheduled reports
* fix some more tests
* move page performance overview to visitors overview
* Adds new table with performance metrics visualization
* Adds some additional information to page performance evolution overlay
* update omnifixture
* updates expected UI files
* Use mediumints for new dimensions
* Adds additional permission check
* Encode label in page performance overlay title
* Improve updating performance metrics in later requests
* Adds some integration tests
* improves metric documentations
* Send already available performance data with page view request
* update tests
* updates expected UI test screenshots
* updates expected test files
* improves archiving
* show page generation time in performance metrics table if matomo was installed before 4.0
* Hide page generation time in ui reports if Matomo was installed after 4.0
* Fix removal of unavailable columns from being displayed
that was done too early in the process causing to be overwritten again by the reports configureView
* do not track automatically calculated generation time any more
* split latency into network and server time
* [TEMP] update php tracker
* rebuilt piwik.js
* Ensure to count zero values as hits
* updates Omnifixture
* updates expected test files
* remove possibility to set generation time
* rebuilt piwik.js
* adjust tests
* update php tracker
* update test logs
* submodule
* update Omnifixture
* show page load time in action tooltip and visitor summary instead of generation time
* updates expected ui files
* mark page generation time metric as deprecated
* fix tests
* [TEMP] use submodule branches
* ensure lower metric values are shown as better
* use 4.x-dev branch of php-tracker
* update submodules
|
|
* many typo fixes in the code thanks to codespell
* reset submodules
I really need to stop using `git commit -a`
* reset change in library
* rebuilt piwik.js
* fix test
* updates expected UI file
Co-authored-by: sgiehl <sgiehl@users.noreply.github.com>
Co-authored-by: Stefan Giehl <stefan@matomo.org>
|
|
* Update VisitExcluded.php
Added option to disable referrer spam blacklist.
* Update VisitExcluded.php
Config parameter changed to enable_spam_filter.
* Update global.ini.php
Added option to disable spam blacklist.
* Update core/Tracker/VisitExcluded.php
Co-Authored-By: Stefan Giehl <stefan@matomo.org>
* Update core/Tracker/VisitExcluded.php
Co-Authored-By: Stefan Giehl <stefan@matomo.org>
* Update Tasks.php
Added check if spam filter is enabled.
Co-authored-by: Stefan Giehl <stefan@matomo.org>
|
|
enable_processing_unique_visitors_multiple_sites = 1) (#15450)" (#15701)
This reverts commit 65b1fcd4cf1ca12d0852d373071e7577e3dbdef4.
|
|
enable_processing_unique_visitors_multiple_sites = 1) (#15450)
* Process unique visitor metric for Roll-ups (set enable_processing_unique_visitors_multiple_sites = 1)
Alternatively, we could remove this setting completely and always assume we want to process unique visitors across websites. I'm not sure there is any reason not to want this enabled?
* Update Screenshot
Co-authored-by: sgiehl <stefan@matomo.org>
|
|
* only detect php type based on file name
* add config entry
* tweak docs
* fix ui test
* Update screenshot
Co-authored-by: diosmosis <diosmosis@users.noreply.github.com>
|
|
* Renames CustomPiwikJs plugin to CustomTrackerJs
* adds bc for old api class name
* adds update to rename plugin in exisiting config
* update ui tests
* rename again
* remove old events
* improve changelog
* remove bc fallback
* Improve migration
* use tagmanager submodule
* updates UI files
|
|
|
|
|
|
|
|
|
|
* Removes deprecated Plugin.getListHooksRegistered and uses Plugin.registerEvents instead
* Removes deprecated method Piwik\Piwik::doAsSuperUser
* Remove deprecated SettingsPiwik::isPiwikInstalled and use SettingsPiwik::isMatomoInstalled instead
|
|
|
|
|
|
(#15328)
This reverts commit 520ba4881ab9d3e30c3d16da9e32a74633e6653c.
|
|
|
|
progress (#15272)
* Use a lock when archiving and do not invalidate when archiving is in progress.
* Add and fix tests + modify workflow.
* forgot to add file and remove TODO
* Remove use of argument.
* Add back min archive time processed code and start on tests for it.
* Finish new LoaderTest.
* Fix new tests.
|
|
|
|
fix https://github.com/matomo-org/matomo/issues/15087
See eg https://github.com/matomo-org/matomo/issues/15087#issuecomment-549495976 and https://github.com/matomo-org/matomo/issues/15087#issuecomment-549503538
|
|
release (#14991)
* trying to remove example plugins
* remove example plugins on next update
* fix screenshot test
|
|
* Add enable_custom_logo config setting to control whether user is permitted to upload logos
* Rename method, add check in setBrandingSettings
* Update Controller.php
* Update expected screenshot
|
|
* Allow row metadata to be datatables in API output.
* Fill out initial DataComparisonFilter.
* fixing some issues
* couple more fixes
* couple more fixes + initial system test
* more fixes
* Finish up segment comparison system test and get to pass.
* Soft limit for number of segments/periods.
* Add supportsComparison method.
* Add UX code for adding/removing/seeing data comparisons + code to forward query parameters in AJAX requests + allow broadcast to handle multi-value query param values.
* Start showing comparison tables in html tables.
* Adding all comparison rows to html table visualization and adding "all visits" segment translation and add currently selected segment to comparisons table.
* Show totals ratio for comparison rows.
* finished poc html table visualization support for comparison
* start working on comparisons support in graph visualizations
* Some UX tweaks to htmltable and add comparisons to bar/pie graphs.
* Getting comparisons to work in evolution graphs.
* Get row evolution to work properly in comparison table.
* Get segmented visitor log to work in comparison tables.
* Fix regression in comparisons in evolution graph.
* Get comparisons to work in actions datatable, fix twig issue that results in 100% cpu usage (when reading dataTable param w/ many rows & comparison tables), get overlay/transitions icons to appear, overlay should work properly.
* Get transitions and overlay to work in comparison rows.
* Fixing some datatable API output issues, fixing tests, support comparisons in subtables by forcing idSubtables of comparisons to be sent in request (makes UI work, but not pracitcal for API).
* Remove typo.
* apply original change
* Allow All Visits default segment to be compared.
* working on disabling currently compared segments.
* Get currently compared segments code to work.
* starting on refactoring datacomparisonfilter
* Most of refactor done.
* Get tests to pass and fix a bunch of datatable metadata consistency issues.
* Modify evolution graph to modify compare parameters and show some sort of accurate comparison line graphs.
* Set xaxis labels correctly in tooltips and make sure series data for comparisons is set correctly.
* more fixes to displaying evolution comparisons where compared date ranges vary in length + make sure normal reports w/ no data display the no data message even when comparing
* Show period type in comparison card.
* Unsanitize compare segments.
* Get correct period count.
* Couple more fixes to evolution graph series labels, but still wonky.
* Include comparison series label in comparison output so evolution graph has an easier time of building series data.
* For multi period vs multi period show correct compareDate/comparePeriod for child tables.
* Redesign period selector comparison section and get to work.
* Allow plugins to disable comparisons for specific pages.
* Start supporting comparison in sparkline visualization.
* Get sparkline points & lengths to work correctly when comparing.
* Fix comparison enabling check.
* Pick series and shade colors.
* Rewriting comparison card to show individual serieses.
* Rewrite comparisons cards to only show segments as cards and individual serieses inside the cards.
* Use comparison colors and shades in evolution graph + fix a couple bugs.
* Tweak series colors and fix a couple regressions to comparison totals calculation.
* Add ratio tooltip suffix explaining comparison percent.
* fix typo
* Forward comparison params in report export.
* tweak series colors again + add tooltip with visitssummary metrics to comparison rows + fix a bug in using array query params in piwik-api + fix bug in formatting of comparison table metrics
* Tooltip fixes, start on sparklines supporting comparison, modify comparison filter to only calculate change metrics against periods since they are time related.
* Sparkline comparison support.
* Tweak line thickness and set metric index properly in jqplot data generator.
* In sparklines comparison, show evolution for compared period, rewrite top tooltip to be better, fix tooltip issues when multiple metrics used in evolution graph, and get comparison to previous period to work.
* Update submodule
* Make things look ok w/ a very long segment name, add numbers to compared datatable row labels, fix pie chart colors + a couple other regressions.
* more bug fixes
* Fix query param retrieval issue.
* Do not throw if no comparison params specified, just do nothing.
* try to fix a couple warnings
* Another query param get fix.
* Do not save comparison parameters.
* pass by reference
* fix JS error
* DO not set compare params if not set in URL for dashboard widgets.
* Fix comparison table styling in dashboard.
* Expand bar graph if there are too many bars when comparing.
* tweak comparison bar graph sizing
* make sure flatten works w/ comparison
* Apply compute processed metrics to comparison tables.
* Hack to get Goals.get to be formatted during comparison.
* Fix ordering of yunits in evolution graph.
* If rows are selected, incorporate into comparison series names.
* Format revenue properly in goals comparison sparklines.
* First working attempt at adding Referrers.get method for use w/ Sparklines visualization.
* get referrers sparklines to work w/ comparison
* Finish using new referrers API method and get referrers sparklines/evolution graph to play well w/ each other in comparison mode.
* Simplify table comparison view if only comparing periods, no segments.
* Take into account visible rows when calculating series metric index.
* Get comparison to work when totals rows are added to tables.
* Show series color in evolution graph tooltip.
* Fix error when loading row evolution/segmented visitor log for compared ranges.
* fix regression in normal subtable loading
* Fix row style
* Forward comparisonIdSubtables parameter if present so it is used when changing limit/offset
* Initialize the row index prefix to the filter offset.
* Do not show period header if only segments compared in table.
* Add UI tests and fix issues so they pass locally.
* quick tweak
* Fix PHP error
* Updating screenshots
* Fixing several bugs and updating expected screenshots.
* Fix comparison tests and clear some TODO.
* Prefix referrers metrics.
* Revert "apply original change"
This reverts commit 8f6ceb0430e5c7306a777498199ad7db21fd7175.
* Show period label if comparing two periods of same type.
* segment sanitization fixes
* More segment fixes.
* Another fix to the tooltip.
* Fix related reports when comparing + make totals tooltip clearer + store segment + pretty title in datatable metadata so it does not have to be looked up every time.
* Allow disabling comparisons for individual uses of visualizations.
* Remove limit on hover for actions tables + fix subtable expansion for normal actions tables.
* Make sure parameters are arrays.
* Stricter check for empty parameters.
* Allow first compared segment to be "removed".
* several more fixes
* Fixing table cell alignment and width and everything else that broke while making changes (hopefully).
* Several fixes, including xss fixes and test fixes and bug fixes for comparisons.
* more table css tweaks
* Correct workings of previous period/year comparison + always convert periods to ranges when comparing in evolution graph.
* Correct workings of previous period/year comparison + always convert periods to ranges when comparing in evolution graph + more css tweaks.
* fix more test regressions
* Forgot to add file
* fix several TODO as well ass get comparison sparklines to have right colors in widgets.
* Use DataTable metadata instead of getting available segments.
* When comparing periods that do not uniformly support unique visitors, do not display unique visitors metric.
* Small refactor and make sure sparklines shows over period w/o using lastN.
* more refactoring and fixes
* some more refactoring
* Move comparison index math to helper methods.
* Use piwikUrl.getSearchParam
* Process comparison tables like normal tables in API.getProcessedReport.
* remove some code redundancy
* use new format date method
* Add first working unit test for comparisons service.
* Finish writing unit test for comparison service.
* refactor comparisons service and fix a couple regressions
* Fix more TODO items and refactoring.
* Fill out more TODO.
* Remove more TODO.
* Fixing some tests.
* another test fix
* FIx some more tests.
* More test fixes and regression fixes.
* Do not add segments to summary rows in actions reports.
* more test fixes
* fix more tests
* more test fixes
* Fixing more tests.
* Fixing more tests + debugging failing one.
* Fix twig loop issue
* Make sure empty compare params are not used in URL.
* Remove cached request array.
* Support comparison rows in multirow evolution popover and LabelFilter.
* Tweak placement of some icons.
* Forward current segment in reporting menu links.
* Fix for split dimension view.
* tweak css
* Add more tests.
* Add year to xlabels in evolution graph (but not xaxis tick).
* applying review feedback
* Apply more PR feedback
* remove debugging code
* tweak event docs
* Fix test.
* fix some test
* fix a test and regression
* updating tes files + fixing test
* Fix regression
* Fix dropdown z-index issue (or workaround really).
* Fixing tests again.
* Update screenshots
* Fix bug and remove some debugging code
* Apply review feedback.
* Make sure ratio tooltips show in widgetized mode.
* Fix some UI tests.
* Fix tests
* Fix a couple more tests.
|
|
outside webroot) (#14866)
* Fix user path was not working as it should
* fix error
|
|
* platform tweaks
* prevent failing if loaded twice
* Update Config.php
* Update PluginList.php
* Update Config.php
* Update IniFileChain.php
* Update Config.php
* Update Config.php
* allow configure different path for custom logo
* only show install plugin button when activated
* allow disable users and sites management
* do not allow calling set super user access
* Update PluginList.php
* Update Config.php
* Update global.ini.php
* Update Config.php
* Update global.ini.php
|
|
* allow configuration of max execution time
* trigger event when query time exceeded
* fix screenshot test
* added some tests and mention mariadb not supported
|
|
|
|
* use temporary table when segmenting
* still apply original where
* do not apply where twice
* make sure to sort tables correctly
* performance tweak, no longer a where needed in most queries
* fix notice
* have a better cache per date
* small tweaks
* potentially fix an error where we received too many rows
* do not apply any custom force group by
* better handling of log tables to fix some tests
* enable new feature through config
* remove comment
* fix some system tests
* drop table before starting to archive in case archiving fails
* fix more tests
* trying to fix ui test
* save the config change
* use reader when executing ranking queries
* apply review feedback
* drop table only if it actually exists to prevent problems on a reader
* Update JoinGenerator.php
|
|
fixes https://github.com/matomo-org/tag-manager/issues/174
related https://github.com/matomo-org/matomo/issues/14420
related https://github.com/matomo-org/matomo/pull/14625
|
