Image
Top
Navigation

Western Manufacturing

About the Project

This project is the first phase of a safety e-learning program for a company named Western Manufacturing. This scope of this topic includes a short overview on why the safety program is needed, what the company hopes to accomplish by teaching this, and then touches on mandatory protective gear and facility warning signage, and three common workplace hazards. The below highlights the project description, learning objectives, how I went about testing my learning objectives with users of the safety training system, and detailed results.

Client
Personal Work

Created at
DePaul University


Project Description

The purpose of this safety program and the context in which it could be used is for a basic introduction for new hires to the company, for existing employees who change positions, and as a yearly reminder for all employees.

It is never too early to begin safety instruction, especially at a manufacturing facility, since according to OSHA.gov (Occupational Safety and Health Administration), “4,836 workers were killed on the job in 2015—on average more than 93 a week or more than 13 deaths every day.” Out of this number, 21.4% were in the construction/manufacturing industry. Because of this, many companies have put into place a mandated safety program which may also need to follow city or state legal requirements. These safety programs and a goal of “zero accidents” are now the highest priority of most companies, even over production of products. However, many companies only have a very basic safety program which may include the reading of long text documents followed by the requirement of a signature at the end. In creating an interactive eLearning application for a company safety program, it will not only help employees better consume and understand the safety topics, but may also help in preventing future accidents or death.

 


 

Learning Objectives

The learning objectives are based on “A Revision of Bloom’s Taxonomy: An Overview” by David R. Krathwohl (2002).

  1. Explain (2.7) the safety rules and guidelines in relation to the company as a whole and understand why safety is the first priority (Ba).
    (2.7) = Understand: Explaining, (Ba) = Conceptual: Knowledge of classifications and categories
  2. Recall (1.2) what personal protective equipment (PPE) is required to be worn at all times at the facility (Ab).
    (1.2) = Remember: Recalling, (Ab) = Factual: Knowledge of specific details and elements
  3. Classify (2.1) the safety signs throughout the workplace and understand what they signify (Ab).
    (2.3) = Understand: Classify, (Ab) = Factual: Knowledge of specific details and elements
  4. Know how to execute (3.1) the procedure to avoid and eliminate hazards related to fires, falls, and tools (Cc).
    (3.1) = Apply: Executing, (Cc) = Procedural: Knowledge of criteria for determining when to use appropriate procedures
  5. Interpret (2.1) the industry-specific terminology related to personal protection and common hazards featured in this course (Aa).
    (2.1) = Understand: Interpret, (Aa) = Factual: Knowledge of terminology

 


 

Click to View the System Implementation

Western Manufacturing Safety Training

 


 .

Application of e-Learning Principles & Ideas

Multimedia – Use words and graphics instead of only words
multimedia principle

Contiguity – Align printed and spoken words to graphics
contiguity principle

Modality – Use audio narration instead of on-screen text
modality principle

Redundancy – Explain visuals with audio or text, but not both
redundancy principle

Coherence – No extraneous words/sounds/graphics present
coherence principle

Personalization – Use conversational style, polite wording, and human voice
personalization principle

Segmenting – Break lesson into parts
segmenting principle

Practice – Use practice questions to achieve learning objectives
practice principle

Program Control – Use pacing control, but limit learner control for novice learners
program control principle

Feedback – Have immediate and helpful feedback
feedback principle

 


 .

Pre-test and Post-test Questions

These were the questions that were included on both the pre-test and post-test. All learners were requested to take the pre-test, then go through the safety training course, then take the post-test. Their answers were then compared to evaluate learning of the material. The (X) next to the answers highlights the correct choices.

  1. What is the top priority of Western Manufacturing? Choose all that could apply.
    a. The prevention of occupationally related injuries. (X)
    b. Production of our products always meeting the deadline.
    c. Having zero accidents. (X)
    d. Meeting and exceeding our year-end financial goals.
    .
  2. The leading cause of private sector worker deaths in 2015 was:
    a. Improper tool use
    b. Fire related incidents
    c. Falls (X)
    d. Electrocution
    .
  3. What is the proper angle extension ladders should be set at?
    a. All are acceptable as long as the ladder does not wobble when you test it.
    b. 1 to 6 pitch (1 foot out for each 6 feet of height of the landing) (X)
    c. 1 to 4 pitch (1 foot out for each 4 feet of height of the landing)
    d. 2 to 5 pitch (2 feet out for each 5 feet of height of the landing)
    .
  4. Which type of fire extinguisher(s) would you use for a Class “C” fire? Choose all that could apply.
    a. Carbon Dioxide (CO2) (X)
    b. Water
    c. Foam
    d. Dry Chemical (X)
    .
  5. Which group of personal protective equipment (PPE) listed below are required to be worn by all employees at all times at the operating location no matter their job function?
    a. Hard Hats, Safety Glasses, Gloves
    b. Hard Hats, Safety Glasses, Safety Shoes (X)
    c. Hard Hats, Safety Shoes, Respirators, Hearing Protection
    d. Gloves, Hearing Protection, Respirators
    .
  6. What color would a warning sign stating “Caution – Watch Your Step” be?
    a. Red
    b. Orange
    c. Yellow (X)
    d. Blue
    .
  7. What is the acronym that can help you remember the correct steps for using a fire extinguisher?
    _________ (P.A.S.S.)
    .
  8. Who is responsible and accountable for safety at Western Manufacturing?
    a. Management
    b. Director of Safety
    c. Occupational Safety and Health Administration (OSHA)
    d. Employees (X)
    .
  9. Out of all of the equipment we have at our disposal, which is most likely to be abused and cause non-fatal injury?
    a. Table Saw
    b. Crane
    c. Forklift
    d. Hand Tools (X)
    .

Other miscellaneous questions:

On Pre-Test Only:

  • Have you ever previously taken a workplace safety training course? Yes/No/Not Sure

 

On Post-Test Only:

  • Do you have any comments or feedback regarding this course? (Likes, dislikes, technical issues, etc.)

 


 

Results/Evaluation of Course Learning

Number of participants tested: 12
Number of identical questions on pre-test and post-test: 9

Questions correct out of 9 for each user:
questions correct

Other Findings:
Most learners had previous workplace safety training experience: 10 out of 12

Comments/Feedback From Learners:

  • Great learning tool. Very informative.
  • Maybe you should have a narrator speak for the whole session, instead of just the small parts that were narrator spoken.
  • Concise, informative, and easy to understand.
  • This was a well manufactured learning site.

 

Results Comparison

average percent correct
Looking at an average of all scores, post-test scores were over 40% higher than pre-test scores.

 

user comparison scores
100% of learners scored higher on the post-test compared to their pre-test scores

 

mean test scores
Pre-Test:
Mean Score: 3.5, 95% Confidence Interval: 2.993 thru 4.007

Post-Test:
Mean Score: 7.25, 95% Confidence Interval: 6.268 thru 8.232

 

significance and effect size

The p value is 0.000 and is less than 0.05.
Therefore, the probability of this result, assuming the null hypothesis, is 0.000.

Effect size is a quantitative measure of the strength of a phenomenon.
Result of effect size calculation is 3.208 and since it is greater than 0.5 it would be considered a large statistically significant effect. Learning scores were increased from pre-test to post-test by more than 3 standard deviations.

(post-test mean minus pre-test mean) / (average standard deviation)
(7.25 – 3.50) / (1.54 + 0.798) / 2 =
3.75 / 1.169 = 3.208

 


 

Conclusion & Ideas for Further Research/Development

Overall I feel this initial implementation and learner testing was a success. The fact that all learners had a higher score on the post-test than on the pre-test and the effect size was well over the ideal of 0.5, indicates that at least in the short term, I was able to help users gain knowledge about something they did not know when they started the course.

This is positive, however many questions remain. Would these learners be able to retain this knowledge in their long-term memory for an extended amount of time? Would they be able to transfer the knowledge to their everyday experiences and jobs? Would taking this course actually help them prevent an injury or death in the future?

I would make the assumption that the answer to these questions would be most likely no, but this course was also not intended to be the only element of a company safety training program. It is meant to be the first introductory eLearning course of many that will also be used alongside other learning opportunities that would make for a better chance of far transfer of learning, such as in-person interactive demos, monthly safety meetings focused on single topics, and one-on-one discussions.

Thinking long-term, if I were to implement a full safety training program based on the single course I have started, I could then test and evaluate how each element would affect long-term retention of knowledge, far transfer of knowledge, and also see how each would hopefully lower the amount of accidents and injuries after program implementation.

In the short-term however, I could make changes to the course I have created. I would most likely get into more detail about the personal protective equipment (PPE) and facility warning signs (learning objectives 2 and 3), as almost all learners answered those questions correct on the pre-test. Since it appears they already have knowledge transfer from previous experience, I could dive a little deeper and experiment with more difficult questions. The other way I could approach this would be to seek out learners with zero background in workplace training, since 10 out of 12 learners that took my course had previous experience, that could also explain why most got those questions correct.

Another aspect I would change would be the table about which type of fire extinguisher to use on which type of fire (learning objectives 4 and 5). Many learners did answer the questions about this incorrect on both the pre-test and post-test. I feel that a possible cause of this was there being too much information on one page, and learners had to use more cognitive thought to study and focus on the table themselves. While creating it, I was unsure what the best way was to present this information. I felt adding audio to it would make it even more confusing since there was text and a lot of detail. The ideal choice would have probably been to spread out the information on that one page to three separate pages—one for each type of fire, but I was also worried about the time constraints for the assignment.

Again, I do feel the creation and testing of this implementation was successful overall and a great starting point if I were to take this further.

 


 .

View the Video below to see an overview of the process and findings