# LTI Tool Use

The *mart\_general.lti\_tool* keeps track of use of LTI tools in the learning environment.

## BQ Prod Dataset Locations <a href="#ltitooluse-bqproddatasetlocations" id="ltitooluse-bqproddatasetlocations"></a>

mart\_general

## Interactive Mart Dependency Diagram <a href="#ltitooluse-interactivemartdependencydiagram" id="ltitooluse-interactivemartdependencydiagram"></a>

The following visualization shows the construction of this data mart defined in the [UDP marts](https://gitlab.com/unizin-community/unizin-data-platform/marts) repository. More information on the repository and diagram can be found on [this marts page.](https://resources.unizin.org/products/data-and-analytics/unizin-data-platform/data-stores/data-marts)

{% hint style="info" %}
[Click here to open the interactive chart.](https://assets.public.unizin.org/udp-marts/mart/mart__general__lti_tool.svg)
{% endhint %}

<div data-full-width="true"><figure><img src="https://3709019308-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FKYwtHNGgdPXS3PWAlZUr%2Fuploads%2Fgit-blob-0ac1e93b4b26f0c74bbc393be92a05838cd9b918%2Flti_tool.png?alt=media" alt=""><figcaption><p>mart_general.lti_tool</p></figcaption></figure></div>

## Schema <a href="#ltitooluse-schema" id="ltitooluse-schema"></a>

<table data-full-width="true"><thead><tr><th width="299.33333333333337">Field Name</th><th width="175">Type</th><th>Description</th></tr></thead><tbody><tr><td>udp_course_offering_id</td><td>INTEGER</td><td>The UDP ID for the Course offering associated with the LTI tool.</td></tr><tr><td>lms_course_offering_id</td><td>STRING</td><td>The LMS ID for the Course offering associated with the LTI tool.</td></tr><tr><td>sis_course_offering_id</td><td>STRING</td><td>The SIS ID for the Course offering associated with the LTI tool.</td></tr><tr><td>udp_person_id</td><td>INTEGER</td><td>The UDP ID for the person who used the LTI tool.</td></tr><tr><td>lms_person_id</td><td>STRING</td><td>The LMS ID for the person who used the LTI tool.</td></tr><tr><td>sis_person_id</td><td>STRING</td><td>The SIS ID for the person who used the LTI tool.</td></tr><tr><td>role</td><td>STRING</td><td>The role of the person who used the LTI tool, i.e. <em>Learner</em> or <em>Instructor.</em></td></tr><tr><td>role_status</td><td>STRING</td><td>The <a href="https://docs.udp.unizin.org/tables/ref_role_status.html">role_status</a> of the person who used the LTI tool.</td></tr><tr><td>enrollment_status</td><td>STRING</td><td>The <a href="https://docs.udp.unizin.org/tables/ref_enrollment_status.html">enrollment_status</a> of the person who used the LTI tool.</td></tr><tr><td>academic_term_name</td><td>STRING</td><td>The name of the academic term, i.e. <em>Fall 2020.</em></td></tr><tr><td>academic_term_start_date</td><td>DATE</td><td>The start date for the academic term.</td></tr><tr><td>academic_organization_array</td><td>ARRAY&#x3C;STRING></td><td>An array of the name of the academic organization(s).</td></tr><tr><td>academic_organization_display</td><td>STRING</td><td>An array of the name of the academic organization(s) written as a comma-separated string.</td></tr><tr><td>course_offering_title</td><td>STRING</td><td>The title of the Course offering associated with the LTI tool, i.e. <em>Linear Algebra.</em></td></tr><tr><td>course_offering_start_date</td><td>DATE</td><td>The start date of the Course offering associated with the LTI tool.</td></tr><tr><td>course_offering_subject</td><td>STRING</td><td>The subject of the Course offering associated with the LTI tool, i.e. <em>MATH</em></td></tr><tr><td>course_offering_number</td><td>STRING</td><td>The number of the Course offering associated with the LTI tool, i.e. <em>310.</em></td></tr><tr><td>course_offering_code</td><td>STRING</td><td>The code of the Course offering associated with the LTI tool, i.e. <em>MATH 310.</em></td></tr><tr><td>num_students</td><td>INTEGER</td><td>The number of students enrolled in the Course offering associated with the LTI tool.</td></tr><tr><td>udp_course_section_id</td><td>INTEGER</td><td>The UDP ID of the Course section associated with the LTI tool.</td></tr><tr><td>lms_course_section_id</td><td>STRING</td><td>The LMS ID of the Course section associated with the LTI tool.</td></tr><tr><td>sis_course_section_id</td><td>STRING</td><td>The SIS ID of the Course section associated with the LTI tool.</td></tr><tr><td>all_section_enrollments</td><td>STRUCT</td><td>Container to list all sections in which the person is enrolled for a given course_offering. Fields in the struct include: <code>udp_course_section_id</code>, <code>sis_course_section_id</code>, <code>lms_course_section_id</code>, <code>role</code>, <code>role_status</code>, <code>enrollment_status</code>, <code>created_date</code></td></tr><tr><td>instructor_name_array</td><td>ARRAY&#x3C;STRING></td><td>An array of the instructors’ names for the Course offering associated with the LTI tool.</td></tr><tr><td>instructor_lms_id_array</td><td>ARRAY&#x3C;STRING></td><td>An array of the instructors’ LMS IDs for the Course offering associated with the LTI tool.</td></tr><tr><td>instructor_display</td><td>STRING</td><td>The array of the instructors’ names for the Course offering associated with the LTI tool written as a string.</td></tr><tr><td>instructor_email_address_array</td><td>ARRAY&#x3C;STRING></td><td>An array of the instructors' email addresses for the Course offering</td></tr><tr><td>instructor_email_address_display</td><td>STRING</td><td>An array of the instructors' email addresses for the Course offering written as a comma-separated string</td></tr><tr><td>event_time</td><td>DATETIME</td><td>The time that the LTI tool was launched.</td></tr><tr><td>event_day</td><td>DATE</td><td>The date that the LTI tool was launched.</td></tr><tr><td>event_hour</td><td>INTEGER</td><td>The hour that the LTI tool was launched.</td></tr><tr><td>launch_app_url</td><td>STRING</td><td>The URL of the application launched.</td></tr><tr><td>launch_app_domain</td><td>STRING</td><td>The domain of the application launched.</td></tr><tr><td>launch_app_name</td><td>STRING</td><td>The name of the application launched.</td></tr><tr><td>tool_name</td><td>STRING</td><td>The name of the LTI tool.</td></tr><tr><td>is_lti_tool</td><td>BOOLEAN</td><td>A boolean indicating if the tool launched is a LTI tool.</td></tr><tr><td>is_redirect_tool</td><td>BOOLEAN</td><td>A boolean indicating if the tool launched is a redirect tool.</td></tr></tbody></table>

### Fields <a href="#ltitooluse-fields" id="ltitooluse-fields"></a>

#### **num\_students**

The *num\_students* field defines the number of enrolled students in a Course offering. This number is found from the *course\_section\_enrollment* table in UDP’s context store, which keeps track of enrollments in course sections. We count the number of enrollments with a role of ‘Student’ or ‘Observer’ and a role status that is not ‘Dropped’, ‘Withdrawn’, or ‘Not-enrolled’.

#### **event\_time**

The field *event\_time* defines the time the event associated with when the tool launch took place from the LMS. This field is derived from the UDP’s event store.

#### **launch\_app\_url**

This is the fully resolved URL of the launched tool. We pull this from the *object.extensions* chunk of the JSON Caliper event. Usually the URL comes from the *url* key of this chunk, but depending on the tool, it can also come from the *domain* key. We coalesce these values with preference to the *url* key if it exists.

#### **launch\_app\_domain**

The *launch\_app\_domain* is extracted from the *domain* key of the *object.extensions* chunk of the JSON Caliper event. Usually, this will be a subset of the full *url* value. Often, the *launch\_app\_domain* field can be useful to group events together in the event that a single tool has multiple resolved URL values.

#### **launch\_app\_name**

The *launch\_app\_name* is extracted from the *asset\_name* field of the *object.extensions* chunk of the JSON Caliper event. This is often a more human-readable name of the tool that is helpful for front-end reporting and visualization.

#### **tool\_name**

Unizin has compiled a list of common tools that are used across the consortium. The *tool\_name* field does not exist natively in the Caliper event, but instead is defined based on mapping tables we crafted to further help with grouping and organizing LTI tool launches. These mapping tables are the `utility__tool_from_name` and `utility__tool_from_url` tables found in the `mart_helper` dataset in your GCP project.  The *launch\_app\_name,* *launch\_app\_domain*, and *launch\_app\_url* fields are used for this mapping to *tool\_name*, with the preference being *launch\_app\_url* and *launch\_app\_domain.* If the launch app URL, domain, and name are all missing from both mapping tables, the tool name defaults to the *launch\_app\_name* value. If the *launch\_app\_name* value is null, a value of ‘unknown tool’ is returned.

This field alongside *launch\_app\_name* is intended to be the most useful for visualization and reporting. The *launch\_app\_name* field comes directly from the Caliper event, and the *tool\_name* field comes from Unizin’s managed list.

#### **is\_lti\_tool & is\_redirect\_tool**

We separate LTI tool launches from Redirect tool launches. The URL of the tool (*launch\_app\_url*) is critical to determine whether the event in scope is an LTI tool launch or a redirect launch:

<table data-full-width="true"><thead><tr><th width="239.33333333333337"></th><th>Launch App URL</th></tr></thead><tbody><tr><td>is_lti_tool</td><td>Is not equal to '<a href="https://www.edu-apps.org/redirect">https://www.edu-apps.org/redirect</a>'</td></tr><tr><td>is_redirect_tool</td><td>Is equal to '<a href="https://www.edu-apps.org/redirect">https://www.edu-apps.org/redirect</a>'</td></tr></tbody></table>

## Tableau Template Workbook <a href="#lmstooluse-fields-1" id="lmstooluse-fields-1"></a>

As a starting point for visualization for this data mart, Unizin has created a Tableau template workbook available for download here:

{% file src="<https://3709019308-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FKYwtHNGgdPXS3PWAlZUr%2Fuploads%2FrVDYw7BfaJujlHepNH5i%2FLTI%20Tools%20Dashboard.twbx?alt=media&token=7b94d730-d7d9-4867-81ae-65e68ea57d39>" %}
LTI Tools Dashboard Tableau Template Workbook
{% endfile %}

Unizin does not provide active, production support for the visualizations, filters, and aggregations in the Tableau workbooks. They are intended to be used as-is, but modifications are welcome! However, we will provide support related to connecting to source data and any issues with the Bigquery -> Tableau workflow.

Once downloaded, ownership of the workbook is transferred to the user. Unizin does not host the workbook on a Tableau Server instance.

### Connecting to Data <a href="#lmstooluse-fields-1" id="lmstooluse-fields-1"></a>

The default data connection in the workbook is to Unizin's synthetic data. After downloading the workbook, the first step will be to transfer the connection to your own production UDP data. Here is a [guide document](https://docs.google.com/document/d/1v_4JjgCz46nky5WZbZZGmO_6F6E2zoyBYifOSoZJNk4/edit?usp=sharing) to help with this process; Tableau also has a [published doc](https://help.tableau.com/current/pro/desktop/en-us/connect_basic_replace.htm) for replacing data sources. For any issues connecting to source data, please contact <support@unizin.org>.

### Tableau Dashboard Filters <a href="#lmstooluse-fields-1" id="lmstooluse-fields-1"></a>

The following fields are used as filters in the Tableau Workbook:

* Academic Organization - The academic department name.
* Launch App Name - The list of tools that are used.
* Course Offering Code - The course code of the course offering.
* Academic Term - The academic term of the course; the default selection is the current term.

These filters are in scope for all visuals in the dashboard.

### Tableau Visualizations <a href="#lmstooluse-fields-1" id="lmstooluse-fields-1"></a>

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXc4tCDR9sIHvm_tX8teBXP1iEXr9ghOoc1-thMSQhlNC9oOCpwZ3KlP1PZNsJAt1qOTPCPGqDgIEOBW_YXbXvb7MZY6C3HrABD3AjITNXD7_Nv1DZlyiD5gSFpjvPogCyYcxyu7?key=_EN7H-TIR8h53bDB7Z1y6-TS" alt=""><figcaption><p>Metric Cards</p></figcaption></figure>

These metric cards provides a quick summary of tool usage across courses. It highlights the total number of tool launches, unique users, distinct tools used, and courses where tools were launched. This shows the overall adoption and engagement with LTI tools at the institution.

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXc_vXclxHVgaEv6Y8Nm5r-pSfiwuNhwdDwjA_GS7S8AyY1y85mKpT1BHckkYxF0nM9sIB3oOqIQwAr0Jdub1O0yCk2bzVKzzm83lUL5FKXkQ526GL9-JVbUYWkp741VyyQNh0bLDQ?key=_EN7H-TIR8h53bDB7Z1y6-TS" alt=""><figcaption><p>Hourly Timeline</p></figcaption></figure>

The tool usage patterns show when and how often LTI tools are used, helping to identify peak usage times and trends over time. It offers insights into usage patterns across days and hours, supporting decisions around tool support and optimization.

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeJwbw8waPk_1NXFSXyOMoCw1hgOYsoBuvi9Oe44auRL5rUbKmf1DucUMa1nB4qiuOaeSRG2UdjlttXY6uaw4lgM6ZuMetcLDAFvWc7qECtdEVij93iYks0d6kS48nudsRp6djmTg?key=_EN7H-TIR8h53bDB7Z1y6-TS" alt=""><figcaption><p>Course Distribution</p></figcaption></figure>

Courses are grouped by the number of unique LTI tools they use, helping reveal patterns in tool adoption. The distribution also highlights engagement levels across courses and shows how widely tools are being integrated into the learning experience.&#x20;

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXe5ezL-grx8rDbnWpGSekLFRPRFSARnUvHETo7vXE0tV3EGzWnqsmLZDR5yFdJgh69tx70yBs8yWACt80Avoj7PDVmd3MPbHP1t_eFkchyi7NRovTdxISzshASnLQ3OATxkRPy5?key=VG1pbSf9aQFJODIZwQ5FPQ" alt=""><figcaption><p>Student Distribution</p></figcaption></figure>

Students are categorized based on the number of unique LTI tools they have interacted with. The chart displays the percentage of students in each group, helping to understand engagement depth and how broadly tools are being utilized by the student population.&#x20;

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXf7nrWIBDtbMB93zujmzBGyb4KF2UNPqI4NtXrVHO1q170UISXqcEQ5Uwr43BcffCziMUyGmmHj3F9vPQYJDhtS7VhVwJgj5ysbVRTm_pHkiypuBQfw3GoLmrrjQ1yB3HijlmiZXw?key=_EN7H-TIR8h53bDB7Z1y6-TS" alt=""><figcaption><p>Daily Timeline</p></figcaption></figure>

Tool usage breakdown across the week shows how the LTI tool usage is distributed across each day of the week, This helps identify which days see higher engagement, supporting scheduling decisions and resource planning.&#x20;

<figure><img src="https://3709019308-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FKYwtHNGgdPXS3PWAlZUr%2Fuploads%2FQWdDpfb9g3ItN5v2MpO1%2Funnamed.png?alt=media&#x26;token=55226fd9-f8ce-489a-8a73-2d6d9ad9935a" alt=""><figcaption><p>Hourly usage distribution</p></figcaption></figure>

Tools usage at different times displays tool usage by hour across all days, helping identify peak hours of engagement.&#x20;

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXc-mpALMKft03zlRMyG3KdnKOXrl266wOPxGhyJYvpGXDwNtH2K4VB1lh8uEYsm6HYYPNakJp0PUncRmPsPtfzlr_Q8dIizVKf45mQjm9-DxTOewTo3B83NMG0K_LUYmhLLThGe-A?key=VG1pbSf9aQFJODIZwQ5FPQ" alt=""><figcaption><p>Frequent Tools Used Per Day</p></figcaption></figure>

Top 15 most frequent tools used per day highlights the most commonly used LTI tools for each day of the week. This view helps identify which tools drive the most daily engagement and supports decisions around tool prioritization.

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeTeNzcDOn5n7Rf4LqncZ8F8oNmzPYn6wf2yBUvwTuh8qu4-ZdKqppmZ_nCM6tNDOHPEUU3I8VSOiUD-G45yl-tAuBEasGF9xG-664J7x5uHRYwHWsGoJvvdqsykmHieBJGQ_yC?key=VG1pbSf9aQFJODIZwQ5FPQ" alt=""><figcaption><p>Frequent Tools Used Per Course</p></figcaption></figure>

This visualization shows the top 15 most tools that are used the most in different courses. It helps to see which tools are most popular and commonly used by students in their courses.&#x20;

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXepK_6RhYnAmnj5BkMNxhPjRQ3NR0mDgy_zRmhJ6nBJDC5Gt76PLZiwOMQrluOzgD3Ga7ZpC0LikP4v1_4yLQ2aGHqRuMuxtRQ5_r-SULUtZrUFkQzbbgSGIL7bqMSrZPtUMGE3kQ?key=VG1pbSf9aQFJODIZwQ5FPQ" alt=""><figcaption><p>Daily Tool Usage Trend</p></figcaption></figure>

This chart tracks the total number of tool launches each day for different tools, showing how usage changes over time. This helps to identify patterns and fluctuations in tool engagement during the course.&#x20;

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXflWAsLWaqSfj3g8t-1FF1hFHsfIvr6ArSTmZYjW48xu1nGZxH3OwMuWKrdEza7Fkk-66uYaFov6pN2Hx6nACl-y_FXWMSAyIfM8M558A3B7m9mr9NpE79-lsC9rshYXWB7Xh80lg?key=_EN7H-TIR8h53bDB7Z1y6-TS" alt=""><figcaption><p>Tools Used Per Student and Course</p></figcaption></figure>

This table displays usage patterns, such as the average number of launches per course or student, for different tools. It helps provide insights into overall engagement of tools at the institution.&#x20;

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeBRe2Jdy9_MmZnA9b4XFzLA3SMq0emx_mQkNiDS4K-hXsxv2SOFcdnvZCMQ2mouNo6fc1ODYieRVjLtLWJzpxMVrVYMpcvrS8jvbwoj1oyo9SJxeI-qnL0Fzv4OWqFVqh7KskN3w?key=_EN7H-TIR8h53bDB7Z1y6-TS" alt=""><figcaption><p>Academic Data Overview</p></figcaption></figure>

Academic data overview displays overall tool usage metrics for courses, as well as contextual data about the course, such as department, course title, and instructors. This overview provides insights into how LTI tools are utilized across various courses and departments, helping to understand engagement and tool adoption in academic settings.&#x20;