FIGURE

3,095,653

Patented July 2, 1963

3 095 653

METHOD OF TESTING THE LEARNING OF
PERSONS

Robert E. Corrigan, Garden Grove, Calif., assignor to Corrigan Communications, Inc., Garden Grove, Calif., a corporation of California

Filed Apr. 11, 1960, Ser. No. 21,167
14 Claims. (CI. 35—9)

The present invention relates generally to a method and apparatus which are especially useful in the testing of and the evaluating of the learning of persons and more particularly to such apparatus which is capable of immediately informing the student of the correctness of his answers to questions asked of him during the testing process and where such responses by the student are recorded in a form for evaluation of individual and group performance by automatic processing machines for said testing situations.

The present invention is directed to method and apparatus by which a single instructor or instruction mechanism may control the testing situation simultaneously for many students separated from the instructor and from each other in such a manner that (a) each student receives immediate knowledge of results of his individual efforts after every attempt to answer every question and (b) each response by each individual student is tabulated automatically on a storage medium at the time of the response. The method may be carried out by means of various forms of the apparatus through any communication medium and in any remote or local testing situation.

Specifically, the present invention provides method and apparatus by which a specific student response at any remote location may be compared with the appropriate correct response desired by the instructor. Also the results of the comparison may be used to inform the student instantly of his individual success. Moreover, the results of the comparison may be used to effect storage of the individual student's responses. The instructor may be informed of 'the behavior of the students, in mass or individually, for single questions or combinations thereof.

The method and apparatus of the present invention has a primary use in the field of testing and evaluation with persons through the medium of television. In instruction with television it is desirable to give tests periodically to students for the purpose of evaluating their acquisition of knowledge and for giving intermediate and final grades in a specified course. In conventional practice the television instructor has no direct contact with or control of each television student. The television student in heretofore proposed methods writes on a piece of paper or selectively by other means records his answers to test questions which can then be mailed to the administrator of the course by the individual student. Alternatively, these answers are collected by the class monitor for groups of subjects and then transported to the television instructor. Such heretofore-proposed methods give rise to several serious deficiences, as for example, the television instructor is not in direct contact with each television student. Additionally, .the television instructor cannot control the time period which the students spend on each question; nor can he control the definitive time allotted for each, student to respond to each specific question. There is no assurance, therefore, that the student will not wait for the answer provided by the television instructor following the presentation of the test question, and then to record it as being correct. Finally, the individual television student is not provided immediate knowledge of results of the correctness or incorrectness of his responses to the test questions as they are made. It has been found that the student will learn more efficiently if during the testing period he is informed of the correct

ness of his answer immediately after he has selected it. This cannot be done with prior testing devices with television because methods have not been devised by which the student can be individually informed of the correct

5 ness of his choice and each successive choice as in the case of multiple choice questions.

It is a major object of the present invention to provide a novel method and apparatus that overcomes the abovementioned deficiences of the prior art.

10 Testing methods and apparatus incorporating the principles of the present invention overcome these shortcomings of the heretofore proposed methods by sending from the studio a coded signal and sensing such signal at any particular television set with which the apparatus is used,

15 comparing this signal with an input generated by the students as they select what they believe to be the correct answer, informing .the students of the result of .this comparison and storing the result on card storage. In the case of multiple-choice questions, a proper signal is broad

20 cast by the television station to each television set in such a manner which allows the identification of each choice as correct or incorrect. Then, the apparatus of the present invention can pick-up that signal for the comparison purposes mentioned above.

25 Another object of this invention is to provide apparatus which will enhance testing efficiency through media such as television.

It is a further object of this invention to provide novel apparatus for testing the knowledge of a television viewer 30 which will immediately inform that viewer on an individual basis of the results of test questions taken with the use of such apparatus.

A still further object of this invention is to provide apparatus for use with a means which transmits intelli35 gence in the form of signals; said apparatus being capable of recording inputs from an operator, comparing those inputs with the signals, and informing the operator of the results of the comparison.

It is still another object of the present invention to provide a unique system which is capable of obtaining information from a television set by which questions are asked of an individual viewer and using that information to inform that viewer on an individual-or group basis of the accuracy of such inputs as answers to the questions.

It is a still further object of the present invention to provide for use with ordinary television sets, apparatus which is capable of sensing intelligence in the form of signals on the television screen, recording inputs from persons viewing the television screen, controlling the position of those inputs, comparing those inputs with the signals, and immediately informing such persons of the results of the comparison for each test question presented. Other objects of this invention will become apparent in 5g the detailed description below in conjunction with the attached drawings wherein:

FIGURE 1 is a pictorial view of the receiving station apparatus of a testing system incorporating the principles of the present invention; gQ FIGURE la is a fragmentary view of a corner of a television screen in front of which is located the pick-up of the system shown in FIGURE 1;

FIGURE lb is a complete block diagram of the system embodying the present invention showing the transmitting 65 and receiving station functions;

FIGURE 2 is a general block diagram of said system; FIGURE 3 is a chart illustrating the results of forming various combinations of light and dark in front of the pick-up photo cells of the system shown in FIGURE 1; 70 FIGURE 4 is a vertical cross-sectional view of the recorder shown in FIGURE 1 taken along line 4—4 in that figure;

45

50

4

FIGURE 5 is a vertical cross-sectional view taken along line 5—5 of FIGURE 4;

FIGURE 6 is a vertical cross-sectional view taken along line 6—6 of FIGURE 4;

FIGURE 7 is a fragmentary vertical sectional view taken along line 7—7 of FIGURE 4;

FIGURE 8 is a partially cut away top plan view of the recorder;

FIGURE 9 is an enlarged fragmentary top view of an escapement mechanism used with the recorder;

FIGURE 101 is an enlarged fragmentary cross-sectional view of an escapement mechanism selector switch of the recorder taken along line 10—10 in FIGURE 5; and

FIGURE 11 is a detailed electrical schematic diagram of the system shown in FIGURE 1.

The System in General

Referring first to FIGURE 1, there is shown a suitable receiving station apparatus of a testing system embodying the present invention. This receiving station apparatus includes a conventional television set T having a television screen or tube face 15. A pickup P is positioned at the lower right-hand corner of the screen 15. A recorder S is operatively connected to the pickup P as by means of suitable cables.

Referring now to FIGURE lb, there is shown a block diagram of a system embodying the present invention. It should be noted that the television set T is adapted to receive coded signals from apparatus such as a conventional television transmitter. These coded signals may show up as two spots on the screen 15 of each television receiver T comprising the system. It should be particularly observed that although a television communication system is shown and described in conjunction with the present invention, other suitable communication media may be employed.

The television transmitter is shown operatively connected to a suitable answer encoding device. This device will automatically apply the proper coding to the signals sent by the transmitting apparatus each time the instructor or an instruction mechanism selects one of a plurality (such as three) answer keys. Where these coded signals consist of tv/o spots on the screen 15 either spot may be independently switched to black or white as required responsive to the output of the encoding device. The encoding device allows the instructor to enter information as to correct answers into the system. This information is transmitted through the system by means of the transmitter, the television receivers T and pickup P to a decoding device forming a part of the aforementioned recorder S. This permits a comparison device also forming a part of the recorder S with a standard against which to compare the responses received from the students by means of a student response device forming part of their individual recorders S. The results of such comparison are transmitted to a student knowledge result panel for viewing by the student. This panel also forms a part of the recorder S. The student responses are additionally entered into a storage register forming a part of the recorder S. In the preferred embodiment of the present invention such entries are made by means of punches in a conventional punch card, such as those presently marketed by International Business Machines and commonly termed IBM punch cards. The storage register is prepared to receive each student response from the student response device Y. The recorder S also includes a student storage advance device that advances the storage medium into position for receiving each subsequent student response. The storage medium; i.e. the IBM punch card may be removed from the recorder S and transported to a central evaluation center shown in FIGURE lb. At this center the student responses are evaluated and data is compiled concerning the student's performance.

The Receiving Apparatus in General

The present apparatus is particularly adapted to handle

questions with which are given a plurality of multiple choice answers, as for example, three multiple choice answers. Therefore, groups of questions with three answers may be assumed as being shown sequentially on the

5 screen 15 of each television set T. Simultaneously, as illustrated in FIGURE la, a signal to indicate the correct answer is broadcast in a conventional manner to illuminate either or both of a pair of spots 16 and 17, respectively, on the lower right-hand portion of screen 15.

10 The pickup P has a left-hand photo cell L and a righthand photo cell R of conventional construction which are placed in alignment with the spots 16 and 17 to sense the signal and feed it to the recorder S. To aid in this positioning, alignment lines 18 may be broadcast on the screen

15 15 prior to the test. Then, as illustrated in phantom lines, in FIGURE la, protuberant portions 19 provided on the housing of the pickup P are aligned with these lines 18 by properly positioning the telescoping stand 20' which supports the pickup P.

20 Referring now to FIGURE 2, the pickup P is shown adjacent the screen 15 at the left-hand portion of this figure. It will be observed that connection to photo cell L is a conventional electrical amplifier 22 which, when the photo cell L is exposed to light at spot 16, actuates an electric

25 solenoid switch 24. A conventional electrical amplifier 23 is connected to similarly operate switch 25 when photo cell R is exposed to light at spot 17. Preferably, the amplifiers 22 and 23 are of the transistor type. As can be seen, the switch arms of switches 24 and 25 are con

30 nected to one side of a 110 volt power source through lead 26. With this arrangement, a circuit may be completed through leads 27 and 28 or both, whenever either switch 24 or switch 25 or both are actuated. In FIGURE 3, there is shown a chart illustrating the

35 results of forming various combinations of light and dark in front of the photo cells L and R. As illustrated by the left two columns in FIGURE 3, four signals may be sent by the two photo cells L and R. The signals are transmitted to the rest of the circuit through leads 27 and 28

40 >by connecting a circuit through lead 27 or through lead 28, or through both of these leads, or through neither of these leads.

Referring again to FIGURE 2, in order to permanently record the result of the tests the recorder S utilizes an

45 IBM-type punch card or Re Rand, etc. 31 that is carried in carriage 32 which is continuously urged to the left by tension on a cable 33. Connected to both sides of the 110 volt power source through wires 37 and 37a is main switch means 34. As illustrated, switch means 34 is con

50 nected to leads 27 -and 28 through scrambling means 35 and leads 38 and 39. The scrambling means 35 essentially comprises several pairs of opposed contacts which cooperate with pre-punched holes in the card 31 and are capable of transposing, superimposing or otherwise scram

55 bling any signal through wires 27 and 28. Many permutations of the original signal are available through the use of this scrambling system. The apparatus, however, can operate without using the scrambling means. Therefore, in order to facilitate the description of. the present system,

go the mode of operation will be described initially on the basis that any current through wire 27 passes directly into lead 38 only and similarly lead 28 is connected only to lead 39.

Located below the carriage 32 is escapement means 40 65 which cooperates with a series of pins (not shown) depending from the underside of the carriage 32. The escapement means 40 is connected to the switch means 34 by leads 46 and 47 as well as to one side of the 110 volt power source through lead 48. Further, because of the 70 circuitry within switch means 34, the escapement means allows cable 33 to move the carriage 32 one position to the left every time the light is removed from photo cells L and R, i.e., when spots 16 and 17 are not illuminated, (see FIGURE 3.) 75 Connected to the switch means 34 through leads 41, 5

42, and 43 and located above the carriage 32 is selecting means 44. The selecting means 44 is connected to one side of the 110 volt power source through wire 45, as illustrated, and also has three buttons A, B and C. Each of these buttons is connected to a punch which will punch 5 the card 31 when the particular button is depressed to record an answer. The buttons A, B and C also have electrical switches connected to each of them which are connected together and through leads 41, 42 and 43 to the electrical switch means 34 in such manner that the fol- 10 lowing results occur (see FIGURE 3):

(1) If the circuit is complete through lead 39 (switch 25 being actuated) and button A is pushed, green light G will be illuminated whereas if either of the buttons B or

C is pushed at such time, red light R will immediately 15 be illuminated to indicate a wrong answer;

(2) If the circuit is complete through lead 38 (switch

24 being actuated) and button B is pushed, green light G will be illuminated indicating a correct answer, whereas

if either the button A or C is pushed at such time, the 20 error indicating red light R will be illuminated;

(3) If the circuit is complete through both leads 38 and 39 (switches 24 and 25 both being actuated) and button C is pushed, the green light G will be illuminated, whereas if either of the buttons A or B is pushed, the red 25 light Y will indicate a wrong answer.

With such circuitry, the present system may be operated in the following illustrative manner. Assume that the instructor or instructing mechanism asks a question having three multiple choice answers, of which A is the 30 correct answer. Simultaneously, the television transmitter will cause each television set T in the system to illuminate at spot 17 on the tube face 15 causing the switch

25 to be actuated. This would complete circuit through lead 39 and the correct answer-indicating green light G 35 will be illuminated only if the button A is pushed. Then, when the instructor is ready to proceed to the next question, the television transmitter darkens the spot at 17, as well as at 16, which causes the escapement means 40 to be actuated, whereupon the carriage 32 is advanced one posi- 40 tion. At this time, the apparatus is ready for the next question.

Mechanical Details of the Recorder

Having described the general manner of operation of the 45 preferred form of apparatus embodying the present invention, reference should now be had to FIGURES 4 through 10 illustrating the mechanical details of the recorder S. The recorder S is enclosed in a housing 49 which performs the dual function of presenting an at- 50 tractive appearance and excluding foreign objects from the operating mechanism of the recorder. Extending longitudinally along the lower left and right-hand sides of the housing are T-shaped frame runners 50 each of which is formed of a pair of right angle members. At- 55 tached to the frame runners are front and rear standards 51 and 52, respectively, which support a pair of guide rails 53, as shown. The aforementioned carriage 32 comprises left and right side members 54 and 55, respectively, which are attached together, rigidly in spaced relation 60 by means of rear plate 56 and front end component 57 extending laterally, as shown. In order to support the card 31, the side members 54 and 55 are each provided with a groove 58. The groove 58 is curved up and cut away at 59 in order that the card may be more easily g5 inserted, as illustrated by the phantom line in FIGURE 4.

Attached to the side members 54 and 55 of the carriage 32 are brackets 60 which have holes through which the guide rails 53 are received. Thereby, the carriage 32 is horizontally slideably supported on the guide rails for 70 forward and rearward movement within the housing 49. To move the carriage 32 rearwardly, the cable 33 extends rearward and then around a drum 61 attached to the rear standard 52 and then back to a spring-driven drum 62. The drum 62 exerts a continuous force on the carriage 75

6

32 and therefore the escapement means 40 may advance the carriage 32, as desired by intermittently releasing it.

The escapement means 40 includes a roll of left-hand pins 64 and a roll of right-hand pins 65 which depend from the lower surface of side member 55. These pins 64 and 65 are staggered. As illustrated best in FIGURES 4 and 9, this arrangement allows a left-hand pawl 66 and a right-hand pawl 67, pivotally secured to a block 68 affixed to a support plate 69, to alternately engage the pins 64 and 65. The pawls 66 and 67 are urged together into pin-engaging relation by a tension spring 70. In order to pull the left-hand pawl 66 out of the path of travel of the pins 64, a conventional electric solenoid 71, affixed to a plate 69 is fastened to the pawl as shown. Similarly, a second solenoid 72 is connected to right-hand pawl 67 to pull the pawl out of the path of travel of the roll of pins 65 when the solenoid 72 is energized.

As will be set forth in more detail in conjunction with FIGURE 11, a double-throw single pole selector switch

73 cooperates with the pins 64 and 65 to cause the solenoids 71 and 72 to operate in proper sequence. As illustrated best in FIGURES 9 and 10, the switch 73 has a roller 74 rotatably supported on a spring arm 75 in such position that the roller is engaged by each left-hand pin 64, as the pin is engaged by the left-hand pawl 66. With this arrangement, the contact closing button 76 of the switch 73 is forced to its lower position when the roller

74 is engaged by the pin 64, as shown. In this condition, the switch 73 will cause the solenoid 71 to be actuated when it is desired to advance the carriage 32.

When the pawl 67 is engaging the pin 65, the roller 74 is not held in its lower position which allows the button 76 to move to its upper position. In this condition, the switch 73 causes the solenoid 72 to be actuated, when desired.

Located in the path of swing of the pawls 66 and 67 are normally open electrical switches 77 and 78', respectively. These switches are provided for the purpose of de-energizing the solenoids 71 and 72 at the proper time, as will be described in more detail below. Latching relay 79 attached to the rear standard 52 is also part of the escapement means 40 and operates as will be described in conjunction with FIGURE 11.

After the carriage 32 has been allowed to move to the rear position, it is pulled back to the front manually. For this purpose a return rod 80, which is encircled at its forward end by washer SI, extends through a hole in flange 82 on rear plate 56, grommet 83 on front standard 51 and a hole in the rear of the housing 49 in slideable relation. With this arrangement, the carriage 32 may be returned to its front position by grasping knob 84 and pulling the rod 80, and therefore the carriage 32, forwardly. Thereafter, one of the pawls 66 and 67 will hold the carriage 32 in that position.

With reference now to the punching apparatus of the selecting means 44, an internal frame component 85 is located at an intermediate position within the recorder S for supporting the punching apparatus. Affixed to the frame component 85 is a depending guide support 86' carrying a punch guide block 87. Punches 88 fastened to buttons A, B and C, respectively, are reciprocably located, as shown, and are resiliently urged to the upper position illustrated by means of compression springs (not shown) disposed within the guide block 87.

Located below the punches 88 and the card 31, is a semi-cylindrical anvil 89 having holes therethrough through which the lower end of the punches 88 may pass in the punching operation. A semi-cylindrical rubber wiper 90 is affixed below the anvil 89 to remove the punched-out portions of the card 31 from the punches 88. The punched-out portions of the card 31 fall into ibox 91 below the anvil 89 where they may be removed through door 92 in the support plate 69.

Each of the punches 88 has a pin 94 projecting for

1
e

wardly to engage a respective actuating arm 95 on a different respective switch 96A, 96B and 9SC. (Switches 96B and 96C are illustrated only in FIGURE 11.) These switches are conventional three ganged, normally open switches. As will be described in detail below, these switches are suitably connected to the wiring of recorder S to cause either the green light G or the red light R to be lit according to the combination of the signal from the television set and the button A, B or C depressed by the student.

Located on the rear side of standard 52 is a left solenoid-operated switch S3 and right solenoid-operated switch 99. In FIGURE 2, these two switches are represented by the block 34 and are activated by the particular signal received through the coding means 35 from the solenoid-operated switch 24 or 25.

■In the embodiment of the invention shown, holes are pre-punched in four of the rows on the card 31. These "coding holes" cooperate with the scrambling means 35 to code the signals from the television set T. The mechanical structure of the scrambling means 35 may be seen in- FIGURES 4, 7 and 8. Located just in front of a punching apparatus is an upper support 101 which is attached at its ends to internal frame component 85 and has a series of four resilient electrical contacts 102a, 192b, 102c and l@Zd affixed to it. These contacts are aligned with rows 2, 3, 8 and 9, respectively, on the card 31 in which the "coding holes" are punched. Attached to the frame component 8'5 immediately below the upper support 101 is a lower support 103 to which resilient electrical contacts 194a, 1046, 104c, and 104rf are affixed in opposed relation to the correlative upper resilient contacts. With this arrangement, the circuit may be completed through the card 31 through coding holes, such as 105 and 106 (FIGURE 11).

Electrical Circuitry of the Recorder S

Referring now to FIGURE 11, the manner in which the recorder S operates will be described in detail from an electrical standpoint. To facilitate the understanding of the schematic diagram in FIGURE 11, the electrical components which form the means represented by the blocks 34, 35, 40 and 44, in FIGURE 2, have been enclosed by dashed lines and are designated by those numbers.

With the contacts 102a and 194a abutting each other through hole 106, solenoid switch 98 will be actuated when light on photo cell L actuates switch 24. Similarly, with contact 102c abutting contact 104c through hole 105 as shown, solenoid switch 99 is actuated whenever light upon photo cell R causes switch 25 to be actuated. To facilitate the understanding of the circuit diagram, the details of the manner in which the scrambling means 35 operate will be deferred until after the entire system has been described.

As shown, the right solenoid switch 99 comprises three ganged switch arms 110, 111, and 112, respectively, which in the unenergized position abut terminals 113, 114 and 115, respectively, said arms contacting terminals 116, 117 and 118, respectively, when the solenoid switch is actuated. Lead 41 is connected to terminal 117 at one end and divides at its other end where it is connected to one of the three ganged switches of each of the switches 96A, 96B and 96C, as shown. Similarly, leads 42 and 43 are connected to terminals 114 and 118, respectively, at one end, and each is divided at its other end to be connected to the switches 96A, 96B and 96C, as shown.

Solenoid switch 98 has two switch arms 12© and 121 which are ganged together. As illustrated, the switch arms 120 and 121, respectively, contact terminals 122 and 123 in the unenergized position and contact terminals 124 and 125 when the. solenoid switch 98 is energized.

Operation of the Selecting Means

In order to understand how the selecting means 44 co

h

operates with the switch means 34 to inform the student immediately whether his answer to the test question is correct or incorrect, let it be assumed that the instructor has given a test question to which multiple-choise answer

g A is correct. In that case, the television transmitter would illuminate spot 17 on the television set screen 15 in front of photo cell R. This would cause switch 25 to actuate which in turn would actuate switch 99. At this time, if the student pushes the A button, thus

10 closing the ganged switches of switch 96A, the green light G would be illuminated because the circuit is closed from one side of the 110' volt power source through lead 45, light G, the top arm of switch 96A, lead 43, terminal 118, switch arm 112, lead 127, terminal 122, switch arm

15 120 and lead 37 to the other side of the power source. If the B button were pushed, the red light Y would be illuminated because a circuit then would be completed through lead 45, light R, the middle arm of switch 963 to wire 43 from which point the circuit is the same as

20 described just above. If the C button were pushed, the red light R would be illuminated indicating an incorrect answer because the circuit would be completed from lead 45, through red light R and bottom arm of switch 96C to lead 43 from which point the circuit is the same, as

25 described in conjunction with button A above.

Assuming that the instructor has given a question to which the answer B was correct, the television screen 15 would be illuminated at spot 16 in front of the photo cell L. This would actuate switch 24 which in turn ac

30 tuates switch 98 moving the switch arms 129 and 121 into contact with terminals 124 and 125. If button A were pushed at this time, the red light Y would be illuminated because a circuit would be complete through lead 45, light Y, the middle arm of switch 96A, lead 42, ter

35 minal 114, switch arm 111, lead 128, terminal 124 and switch arm 120 to lead 37. If button B were pushed the green light G would be illuminated indicating a correct answer because the circuit would be completed from lead 45 through light .G and the top arm of switch 56 B to

40 lead 42 from which point the circuit is the same as described just above. Correspondingly, if button C were pushed, the red light would be illuminated because the circuit would become complete from lead 45 through light Y and the. middle bar of switch 96C to lead 42.

45 If the instructor gives a question to which answer C is correct, he will cause the television screen 15 to be illuminated at both spots 16 and 17 in front of both photoelectric cells L and R. This would cause both switches 24 and 25 to be actuated which in turn would cause

50 switches 98 and 99 to be actuated. If button A were pushed by the student at this point, the red light R would be illuminated because the circuit would be completed from lead 45 through light Y, the bottom arm of switch 96A, lead 41, terminal 117, switch arm 11, lead 128,

55 terminal 124 and switch arm 120, to lead 37. If the student pushed button B, the red light Y would be illuminated because the circuit would then be complete from lead 45 through light Y and the bottom arm of switch 96B to lead 41 from which point the circuit would be

60 the same as described just above. If the student pressed button C, green light G would become illuminated because the circuit would be complete from lead 45 through light G and the top arm of switch 96C to lead 41.

Electrical Circuit of the Escapement Means 40

05

The circuitry of the escapement means 40 is enclosed by the . dashed lines and located at the lower right-hand portion of FIGURE 11. The latching relay 79 has a first solenoid 130 which may be energized to pull ganged

70 switch arms 131 and 132 into contact with terminals 133 and 134, respectively. The relay 79 also has a second solenoid 135 which upon actuation pulls switch arm 136 into contact with terminal 137. It will be noted that two small blocks 138 and 139 are shown located adjacent each

75 other at the ends of the dashed lines passing through the